Method and apparatus for detecting and interpreting path of designated position

ABSTRACT

A method of detecting and interpreting a path of designated positions is disclosed. The method concurrently detects a plurality of designated positions on a touch panel, again detects the plurality of designated positions subsequent to a travel of the designated positions, determines the distances between each of the current designated positions and the respective immediately preceding designated positions, treats an immediately preceding designated position, closest to the current designated position of interest, as the immediately preceding designated position of the current designated position of interest, and acquires the path of each designated position, thereby recognizing the paths of the plurality of designated positions that move concurrently. A combination of the paths of the plurality of designated positions is interpreted to identify a designation input by a user, and an operation thus designated is executed.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a position information processingapparatus, and more particularly, to a position information processingapparatus that detects position coordinates and paths of the positioncoordinates input by a finger, a pen, or a pointer, and interprets aninstruction, input by a user and represented by the path, to perform anoperation.

2. Description of the Related Art

Conventional touch panels allow position coordinates of a plurality ofcontact points to be detected in operation.

Such a conventional device detects a single input at a point as unknowninput data during another point being designated fixedly, and is unableto detect paths of two or more designated positions that areconcurrently moving.

The device thus cannot interpret a designation represented by acombination of paths of a plurality of designated positions that areconcurrently moving.

SUMMARY OF THE INVENTION

It is an object of the present invention to provide an informationprocessing apparatus and an information processing method for detectingpaths of at least two designated positions that are concurrently moving.

It is another object of the present invention to provide an apparatusand method for interpreting a user's designation represented by acombination of paths of at least two designated positions, and forperforming a designated operation.

According to one aspect, the present invention which achieves theseobjects relates to an information processing apparatus and includes adesignated position detector for concurrently detecting a plurality ofdesignated positions, a designated position storage unit for storing theplurality of designated positions detected by the designated positiondetector, a travel path recognizer for recognizing the travel paths ofthe plurality of designated positions based on the plurality ofpreceding designated positions stored in the designated position storageunit and the plurality of current designated positions detected by thedesignated position detector.

According to another aspect, the present invention which achieves theseobjects relates to an operation apparatus and includes a path detectorfor detecting paths of a plurality of concurrently moving designatedpositions, a designation interpreter for interpreting a designationrepresented by a combination of the paths of the plurality of designatedpositions detected by the path detector, and an operation unit forperforming an operation based on the designation interpreted by thedesignation interpreter.

According to still another aspect, the present invention which achievesthese objects relates to a position information processing method andincludes a first detecting step of concurrently detecting a plurality ofdesignated positions, a second detecting step of concurrently detectinga plurality of designated positions subsequent to the first inputdetecting step, and a travel path recognition step of recognizing thetravel paths of the plurality of the designated positions based on theplurality of preceding designated positions detected in the firstdetecting step and the plurality of current designated positionsdetected in the second detecting step.

According to yet another aspect, the present invention which achievesthese objects relates to an operational method and includes a pathdetecting step of detecting paths of a plurality of concurrently movingdesignated positions, a designation interpreting step of interpreting adesignation represented by a combination of the paths of the pluralityof designated positions detected in the path detecting step, and anoperation step of performing an operation based on the designationinterpreted by the designation interpreting step.

According to another aspect, the present invention which achieves theseobjects relates to a computer-readable storage medium storing a positioninformation processing program for controlling a computer to performprocessing of position information. The program includes codes forcausing the computer to perform a first detecting step of concurrentlydetecting a plurality of designated positions, a second detecting stepof concurrently detecting a plurality of designated positions, and atravel path recognition step of recognizing the travel paths of theplurality of the designated positions based on the plurality ofpreceding designated positions detected in the first detecting step andthe plurality of current designated positions detected in the seconddetecting step.

According to another aspect, the present invention which achieves theseobjects relates to a computer-readable storage medium storing amanipulation program for controlling to perform manipulation. Theprogram comprising codes for causing the computer to perform a pathdetecting step of detecting paths of a plurality of concurrently movingdesignated positions, a designation interpreting step of interpreting adesignation represented by a combination of the paths of the pluralityof designated positions detected in the path detecting step, and anoperation step of performing an operation based on the designationinterpreted by the designation interpreting step.

Other objects and advantages besides those discussed above shall beapparent to those skilled in the art from the description of a preferredembodiment of the invention which follows. In the description, referenceis made to accompanying drawings, which form a part thereof, and whichillustrate an example of the invention. Such example, however, is notexhaustive of the various embodiments of the invention, and thereforereference is made to the claims which follow the description fordetermining the scope of the invention.

Further objects, features and advantages of the present invention willbecome apparent from the following description of the preferredembodiments with reference to the attached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing the hardware structure of aninformation processing apparatus of one embodiment;

FIGS. 2A-2C show an example of position inputting using a finger on atouch panel;

FIG. 3 shows an example of position inputting using a finger on an imagepickup device;

FIG. 4 is a flow diagram showing a process of using a path of adesignated position;

FIG. 5 is a flow diagram showing a process of a path detection;

FIG. 6 is a flow diagram showing a combination determination process;

FIGS. 7A-7C show stored designated position data;

FIGS. 8A and 8B show current designated position data;

FIGS. 9A-9D show a flow of data that is used in the detection of pathsof a plurality of designated positions;

FIG. 10 is a flow diagram showing a path detection process using thesize of a designated area;

FIG. 11 is a flow diagram showing a combination determination processusing the designated area;

FIGS. 12A and 12B show an area of an acquired current designatedposition;

FIGS. 13A-13D show the data of the area of the stored designatedpositions;

FIGS. 14A-14D show a flow of data that is used in a process based on thesize of the designated area;

FIG. 15 is a flow diagram showing an operational procedure using thepaths of a plurality of designated positions;

FIG. 16 is a flow diagram showing a process flow of a designationinterpretation process;

FIG. 17 is a flow diagram showing an algorithm for acquiring a change inthe distance between designated positions;

FIG. 18 is a flow diagram showing a designation interpretation processbased on the change in the distance between the designated positions;

FIG. 19 is a flow diagram showing another designation interpretationprocess based on the change in the distance between the designatedpositions;

FIGS. 20A and 20B show an operational example that is interpreted as acontraction operation;

FIGS. 21A and 21B show the corresponding data samples that areinterpreted as the contraction operation;

FIGS. 22A and 22B show an operational example that is interpreted as anexpansion operation;

FIGS. 23A and 23B show the corresponding data samples that areinterpreted as the expansion operation;

FIG. 24 is a flow diagram showing a designation interpretation processusing a change in the angle of designated positions;

FIG. 25 is a flow diagram showing an algorithm for acquiring the changein the angle of the designated position;

FIG. 26 is a flow diagram showing a designation interpretation processbased on the angle change;

FIGS. 27A and 27B show an operational example that is interpreted as aclockwise rotation operation;

FIGS. 28A and 28B show the corresponding data samples that areinterpreted as the clockwise rotation operation;

FIGS. 29A and 29B show an operational example that is interpreted as acounterclockwise rotation operation;

FIGS. 30A and 30B show the corresponding data samples that areinterpreted as the counterclockwise rotation operation;

FIG. 31 is a flow diagram showing a designation interpretation processthat uses a relationship between a designated fixed position and adesignated moving position;

FIG. 32 is a flow diagram showing a designated fixed position detectionprocess;

FIG. 33 is a flow diagram showing a designation interpretation processbased on the direction of travel;

FIG. 34 is a flow diagram showing a process of determining the directionof travel of a designated position;

FIG. 35 illustrates the interpretation of angles used in the designatedposition travel direction determination process;

FIGS. 36A and 36B show an operational example that is interpreted as aleftward shifting operation;

FIGS. 37A-37D show the corresponding data samples that are interpretedas the leftward shifting operation;

FIGS. 38A and 38B show an operational example that is interpreted as anupward shifting operation;

FIGS. 39A-39D show the corresponding data samples that are interpretedas the upward shifting operation;

FIGS. 40A and 40B show an operational example that is interpreted as adownward shifting operation;

FIGS. 41A-41D show the corresponding data samples that are interpretedas the downward shifting operation;

FIGS. 42A and 42B show an operational example that are interpreted as arightward shifting operation;

FIGS. 43A-43D show the corresponding data samples that are interpretedas the rightward shifting operation;

FIG. 44 is a flow diagram showing a designation interpretation processthat uses a change in the distance between a designated fixed positionand a designated moving position;

FIG. 45 is a flow diagram showing a designation interpretation processthat uses the change in the distance between the designated positions;

FIGS. 46A and 46B show an operational example that is interpreted as acontraction operation;

FIGS. 47A-47D show the corresponding data samples that are interpretedas the contraction operation;

FIGS. 48A and 48B show an operational example that is interpreted as anexpansion operation;

FIGS. 49A-49D show the corresponding data samples that is interpreted asthe expansion operation;

FIGS. 50A and 50B show an operational example that is interpreted as acontraction operation centered on a designated fixed position;

FIGS. 51A-51F show the corresponding data samples that is interpreted asthe contraction operation centered on the designated fixed position;

FIG. 52 is a flow diagram showing an algorithm that uses a distancebetween designated moving positions;

FIG. 53 is a flow diagram showing a designation interpretation processbased on a change in the distance between the designated movingpositions;

FIGS. 54A and 54B show an operational example that is interpreted as acontraction operation;

FIGS. 55A-55E show the corresponding data samples that are interpretedas the contraction operation;

FIGS. 56A and 56B show an operational example that is interpreted as anexpansion operation;

FIGS. 57A-57E show the corresponding data samples that are interpretedas the expansion operation;

FIGS. 58A and 58B show an operational example that are interpreted as anoperation for moving a plurality of positions;

FIGS. 59A-59H show the corresponding data samples that are interpretedas the operation for moving the plurality of positions;

FIG. 60 is a flow diagram of an algorithm that uses a change in an angleof the designated positions;

FIG. 61 is a flow diagram showing a designation interpretation processbased on the change in the angle of the designated positions;

FIGS. 62A and 62B show an operational example that is interpreted as aclockwise rotation operation;

FIGS. 63A-63D show the corresponding data samples that are interpretedas the clockwise rotation operation;

FIGS. 64A and 64B show an operational example that is interpreted as acounterclockwise rotation operation;

FIGS. 65A-65D show the corresponding data samples that are interpretedas the counterclockwise rotation operation;

FIG. 66 is a flow diagram of an algorithm that uses a change in an angleof designated moving positions;

FIG. 67 is a flow diagram of a designation interpretation process basedon the change in the angle of the designated moving positions;

FIGS. 68A and 68B show an operational example that is interpreted as aclockwise rotation operation;

FIGS. 69A-69E show the corresponding data samples that are interpretedas the clockwise rotation operation;

FIGS. 70A and 70B show an operational example that is interpreted as acounterclockwise rotation operation;

FIGS. 71A-71E show the corresponding data samples that are interpretedas the counterclockwise rotation operation;

FIGS. 72A and 72B show an operational example that is interpreted as arotation operation about the center of gravity;

FIGS. 73A-73H show the corresponding data samples that are interpretedas the rotation operation about the center of gravity;

FIG. 74 is a flow diagram showing an algorithm that uses a positionalrelationship between designated positions;

FIG. 75 is a flow diagram showing an algorithm for determining apositional relationship between designated positions;

FIG. 76 is a flow diagram showing a designation interpretation processbased on the positional relationship between the designated positions;

FIG. 77 shows an operational example that is interpreted as a verticalshifting operation;

FIGS. 78A-78D show the corresponding data samples that are interpretedas the vertical shifting operation;

FIGS. 79A and 79B show an operational example that is interpreted as alateral shifting operation;

FIGS. 80A-80D show the corresponding data samples that are interpretedas the lateral shifting operation;

FIG. 81 is a flow diagram showing a designation interpretation processbased on a positional relationship between designated positions;

FIG. 82 is a flow diagram showing a designation interpretation processbased on the positional relationship between the designated positions;

FIG. 83 is a flow diagram showing an algorithm for acquiring a change inthe positional relationship between the designated positions;

FIGS. 84A and 84B show an operational example that is interpreted as aninversion operation;

FIGS. 85A-85D show the corresponding data samples that are interpretedas the inversion operation;

FIGS. 86A and 86B show an operational example that is interpreted as alateral inversion operation;

FIGS. 87A-87D show the corresponding data samples that are interpretedas the lateral inversion operation;

FIGS. 88A and 88B show an operational example that is interpreted as avertical inversion operation;

FIGS. 89A-89D show the corresponding data samples that are interpretedas the vertical inversion operation;

FIG. 90 is a flow diagram showing an algorithm for determining apositional relationship between designated positions;

FIG. 91 is a flow diagram of a designation interpretation process basedon the positional relationship to the designated fixed position;

FIG. 92 is a flow diagram showing in detail the designationinterpretation process based on the positional relationship to thedesignated fixed position;

FIG. 93 is a flow diagram showing an algorithm for determining thepositional relationship to the designated fixed position;

FIG. 94 is a flow diagram showing an algorithm for acquiring thedirection of travel of a designated position;

FIGS. 95A and 95B show two operational examples that have differentinterpretations depending on the positional relationship of designatedpositions even though the travel directions thereof are the same;

FIGS. 96A-96D show the corresponding data samples that are interpretedas a next-item operation;

FIG. 97 is a flow diagram showing an algorithm for determining apositional relationship between designated fixed positions and adesignated moving position;

FIG. 98 is a flow diagram showing an algorithm for determining apositional relationship between designated positions;

FIG. 99 is a flow diagram showing an algorithm for determining thepositional relationship between the designated positions;

FIG. 100 is a flow diagram showing an algorithm for acquiring a changein the positional relationship between the designated positions;

FIG. 101 is a flow diagram showing a designation interpretation processbased on the positional relationship between the designated fixedpositions and the designated moving position;

FIGS. 102A and 102B show an operational example that is interpreted as asymmetrical inversion operation;

FIGS. 103A-103E show the corresponding data samples that are interpretedas the symmetrical inversion operation;

FIG. 104 is a flow diagram showing an algorithm for at least threedesignated fixed positions;

FIG. 105 is a flow diagram of a process for determining a positionalrelationship of a designated moving position with respect to a pluralityof designated fixed positions;

FIG. 106 is a flow diagram of a process for acquiring the positionalrelationship between the designated positions;

FIG. 107 shows an operational example which is interpreted to mean thatthe designated moving position is within an area defined by thedesignated fixed positions;

FIGS. 108A-108F show the corresponding data samples which areinterpreted to mean that the designated moving position is within thearea defined by the designated fixed positions;

FIG. 109 is a flow diagram showing an algorithm for acquiring thepositional relationship between the designated positions;

FIGS. 110A and 110B show an operational example which is interpreted asa shifting operation from within an area;

FIGS. 111A-111F show the corresponding data samples which areinterpreted to mean the shifting operation from within the area;

FIG. 112 is a flow diagram showing a designation interpretation processbased on the positional relationship of a designated moving position toa plurality of designated fixed positions;

FIGS. 113A and 113B show an operational example that is interpreted tomean that an attribute is imparted to the area defined by the designatedfixed positions;

FIGS. 114A-114F show the corresponding data samples that are interpretedto mean that the attribute is imparted to the area defined by thedesignated fixed positions;

FIG. 115 is a flow diagram showing a designation interpretation processbased on a change in the count of a plurality of designated positions;

FIG. 116 is a flow diagram showing a designation interpretation processbased on a change in the initial count of designated positions;

FIGS. 117A and 117B show an operational example that is interpreted tomean that the designation of an object to be processed is on its way;

FIGS. 118A-118F show the corresponding data samples that are interpretedto mean that the designation of the object to be processed is on itsway;

FIG. 119 is a flow diagram showing a designation interpretation processbased on the change in the designated position count;

FIG. 120 is a flow diagram showing a designation interpretation processbased on an initial designated position;

FIGS. 121A and 121B show an operational example that is interpreted as arotation operation about a designated position;

FIGS. 122A-122D show the corresponding data samples which areinterpreted as the rotation operation about the designated position;

FIG. 123 is a flow diagram showing an algorithm that uses a change inthe last count of designated positions;

FIG. 124 is a flow diagram showing a designation interpretation processbased on the change in the last count of the designated positions;

FIGS. 125A and 125B show an operational example that is interpreted as acanceling operation to cancel an immediately preceding operation;

FIGS. 126A-126F show the corresponding data samples that are interpretedas the canceling operation to cancel the immediately precedingoperation;

FIG. 127 is a flow diagram showing an algorithm that uses designatedinformation other than a designated path;

FIG. 128 is a flow diagram showing an algorithm that uses designatedinformation other than a designated path;

FIG. 129 is a flow diagram showing an algorithm that uses the count ofall designated positions;

FIG. 130 is a flow diagram showing a designation interpretation processbased on the designated position count;

FIGS. 131A and 131B show an operational example that is interpreted as apage-turning operation;

FIGS. 132A-132H show the corresponding data samples that are interpretedas the page-turning operation;

FIG. 133 is a flow diagram showing an algorithm for acquiring the speedof travel of a designated position as the designated positioninformation other than the designated path;

FIG. 134 is a flow diagram showing an algorithm for acquiring the speedof travel of the designated position;

FIG. 135 is a flow diagram showing a designation interpretation processbased on the designated position travel speed;

FIGS. 136A-136D show an operational example that is interpreted as apage-turning using the designated position travel speed;

FIGS. 137A-137G show the corresponding data samples that are interpretedas the page-turning using the designated position travel speed;

FIG. 138 is a flow diagram showing an algorithm that uses a contactpressure at a designated position as the designated information otherthan the designated path;

FIG. 139 is a flow diagram showing a designation interpretation processbased on the designated position contact pressure;

FIGS. 140A-140D show an operational example that is interpreted as ascreen shifting operation in response to the designated position contactpressure;

FIGS. 141A-141H show the corresponding data samples that are interpretedas the screen shifting operation in response to the designated positioncontract pressure;

FIG. 142 is a flow diagram showing an algorithm that uses the distancesof travel of a plurality of designated positions;

FIG. 143 is a flow diagram showing a designation interpretation processbased on the distances of travel of the plurality of designatedpositions;

FIGS. 144A-144D show an operational example that is interpreted as apage-turning operation in response to the distances of travel of theplurality of designated positions;

FIGS. 145A-145G show the corresponding data samples that are interpretedas the page-turning operation in response to the distances of travel ofthe plurality of designated positions;

FIG. 146 is a flow diagram showing an algorithm that uses stationarytimes of a plurality of designated positions;

FIGS. 147A and 147B show an operational example that is interpreted asan area designating operation;

FIGS. 148A-148D show the corresponding data samples that are interpretedas the area designating operation;

FIGS. 149A and 149B show an operational example that is interpreted asan expansion operation to be effected on a designated area; and

FIGS. 150A-150D show the corresponding data samples that are interpretedas the expansion operation to be effected on the designated area.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Preferred embodiments of the present invention are discussed, referringto the drawings.

FIG. 1 is a block diagram showing the hardware structure of aninformation processing apparatus of one embodiment of the presentinvention.

As shown, for example, an input module 1 is a touch panel for receivinginformation by a position designation. A CPU 2, performing computationand logical determination for a variety of processes, controls elementsconnected to a bus 6. An output module 3 is a display for displayinginformation thereon, a printer for printing out information, or a modemfor transmitting information.

A program memory 4 stores programs which are executed by the CPU 2, aswill be discussed in detail with reference to flow diagrams. The programmemory 4 may be a ROM (Read-Only Memory) or a RAM (Random Access Memory)into which programs are transferred from an external storage device.

A data memory 5 stores data that is created in the course of eachprocess, and knowledge base, as will be discussed later. The data memory5 may be a RAM. The knowledge base may be preloaded from a nonvolatileexternal storage device, or may be referenced in time of need.

The bus 6 transfers an address signal designating an element that is tobe controlled by the CPU 2, a control signal for controlling eachelement, and data to be exchanged the elements.

First Embodiment

FIGS. 2A-2C show an example of position inputting using a finger on atouch panel. As shown, the information processing apparatus knows aninput by acquiring the paths extending between the start points and theend points of two paths A and B at which fingers touch.

In an example 1 of travel of designated position points in a paralleldirection, the distance between the two points remain unchanged, and theresulting paths are parallel. This example may be used to translate anobject.

In an example 2 of travel of designated position points in an inwarddirection, the two points approach each other in the paths thereof. Thisexample may be used to contract or minimize an object.

In an example 3 of travel of designated position points, the two pointsmove away from each other in the paths thereof. This example may be usedto expand or maximize an object.

FIG. 3 shows an example of position inputting using a finger on an imagepickup device. Instead of directly touching the touch panel with thefingers, a user moves the fingers as represented by signs 303 and 304within a effective field 302 of a camera 301. The apparatus recognizes apointed location (at the finger tip), thereby detecting a designatedposition point.

FIG. 4 is a flow diagram showing a process of using a path of adesignated position point. As shown, an input is sensed in step S401.When the end of the input remains undetected, the algorithm proceeds tostep S403. A path detection process is thus initiated. In succession, instep S404, a process in response to a detected path as input informationis initiated.

FIG. 5 is a flow diagram showing the path detection process performed instep S403. In step S501, a designated position detection process isexecuted to acquire coordinate data of current designated positionpoints. In step S502, a combination determination process is performedto determine combinations of current designated position points andimmediately preceding designated position points respectively closestthereto. In step S503, a designated position storage process is executedto store the current designated position point in an optimum designatedposition table (i.e., the same table in which the immediately precedingposition closest thereto is stored).

FIG. 6 is a flow diagram showing a combination determination process instep S502. As shown, step S601 performs a process for determining adistance between one of the current designated position points and eachof the immediately preceding designated position points. In step S602, acombination of the current designated position point and the immediatelypreceding designated position point closest thereto is determined. Whensuch a combination is found in step S603, the algorithm proceeds to stepS604. The current designated position point is then added to the tablethat stores the immediately preceding designated position point to becombined therewith. This series of steps is repeated until no furthercombination is found in step S603.

FIGS. 7A-7C show stored current designated position data that is storedin the path detection process. As shown in a graph 701, the XYcoordinates of a point At₁ are (3,3) at time t₁, and the XY coordinatesof a point At₅ are (7,5) at time t₅. Tables 702 and 703 respectivelystore the coordinate data of the points A and B taken at time pointsfrom t₁ to t₅.

FIGS. 8A and 8B show current designated position data that is acquiredin the path detection process. As shown in a graph 801, there are aplurality of designated position points at time t₆: a point a having XYcoordinates (8,6) and a point b having XY coordinates (8,8). A table 802stores the position data currently acquired (at time t₆).

FIGS. 9A-9D show a flow of data that is used in the detection of pathsof a plurality of designated position points. As shown, a table 901stores the point a (8,6) and the point b (8,8) as the current designateddata. Referencing the current designated position data, a distance iscalculated from each of the current designated position points to eachof the immediately preceding designated position points. For example,the apparatus determines a distance of 1.414 from the point a to theimmediately preceding designated position point At₅ and a distance of4.123 from the point a to the immediately preceding designated positionpoint Bt₅.

As a result, the point a is stored in a table 903 which stores theimmediately preceding designated position point At₅ closest thereto.Similarly, the point b is stored in a table 904 which stores theimmediately preceding designated position point Bt₅ closest thereto.

FIG. 10 is a flow diagram showing a path detection process using thesize of a designated area. In the above process, the path is determinedbased on the assumption that each of the current designated positionpoints is linked to one of the immediately preceding designated positionpoints closest thereto. Here, a path is determined based on theassumption that each of the current designated position points is linkedto one of the plurality of preceding designated position points having adesignated area (for example, a contact area by a finger on a touchpanel) closest in size to the area of the current designated positionpoint.

As shown, a designated area detection process is initiated to acquirethe current designated area in step S1001. In step S1002, a combinationdetermination process is initiated to determine a combination of thecurrent designated area and the immediately preceding designated areaclosest thereto based on a difference between the current designatedarea and the immediately preceding designated area. In step S1003, adesignated-area storage process is initiated in step S1003 to store thecurrent designated area in an optimum table (i.e., the table that storesthe immediately preceding designated area closest to the currentdesignated area).

FIG. 11 is a flow diagram showing the combination determination processusing the size of the designated area in step S1002. As shown, in stepS1101, a process is initiated to determine a difference between thecurrent designated area and the immediately preceding designated area.In succession, step S1102 determines a combination of the currentdesignated area and the immediately preceding designated area closest insize thereto. The algorithm proceeds to step S1104 when any combinationis found in step S1103. The current designated position point and thearea thereof are added to the table of the immediately precedingdesignated position point and the area thereof respectively closest inposition and size thereto. This series of process steps is repeateduntil no further combinations are found in the step S1103.

FIGS. 12A and 12B show an area of an acquired current designatedposition point. In a graph 1201, the current designated position is thepoint a(8,6). An enlarged view 1202 shows the touch state of the touchpanel when the point a is pressed. The area of the designated positionpoint is thus determined.

FIGS. 13A-13D show the data of the area of the stored designatedpositions. As shown, in a graph 1301 at time t₁, the XY coordinates ofthe designated position point At₁ are (3,3) and the XY coordinates ofthe designated position point Bt₁ are (12, 14). At time t₅, the XYcoordinates of the designated position point At₅ are (7,5) and the XYcoordinates of the designated position point Bt₅ is (8,8). There alsoexist a current designated area 1 containing the point a(8,6) and acurrent designated area 2 containing the point b(8,8) at time t₆.

In a table 1302, the area A of the point a is 12.5 at time t1, and thearea data of the point a at subsequent time points between time t₁ andtime t₅ are also stored in the table 1302. Similarly, the data of thearea B of the point b at each time point is stored in a table 1303. Atable 1304 stores an area of 11.5 containing the point a and an area of20.0 containing the point b as the acquired designated data at currenttime t₆.

FIGS. 14A-14D show a flow of data that is used in a path acquisitionprocess based on the size of the designated area. As shown, a table 1401lists, as the current designated area data, an area of 11.5 containingthe point a(8,6) and an area of 20.0 containing the point b(8,8).Referencing the current designated area data, the apparatus acquires adifference between the current designated area data and the immediatelypreceding area data and stores the difference in a table 1402. Withrespect to the designated area 11.5 containing the point a, theapparatus thus acquires a difference of 0.5 from the immediatelypreceding area A and a difference of 9.0 from the immediately precedingarea B.

The designated area data 11.5 containing the point a is thus stored in atable 1403 that stores the immediately preceding area A that results inthe minimum difference. Similarly, the designated area data containingthe point b is stored in a table 1404 that stores the immediatelypreceding designated area B.

Second Embodiment

A second embodiment of the present invention is discussed. In the secondembodiment, a process for interpreting an operation to perform is basedon a combination of travel paths of at least two designated positionpoints.

FIG. 15 is a flow diagram showing an operational procedure using thepaths of a plurality of designated position points. An input is detectedin step S1501. The algorithm proceeds to step S1502. When the end of theinput remains undetected in step S1502, the algorithm proceeds to stepS1503, thereby initiating a travel path detection process. In stepS1504, a designation interpretation process is performed, and in stepS1505, a process in response to the designation is initiated.

FIG. 16 is a flow diagram showing a process flow of the designationinterpretation process in the step S1504. In step S1601, a designatedposition-to-position distance measurement process is initiated tomeasure a distance between current designated position points. Insuccession, step S1602 performs a process for acquiring a change in thedesignated position-to-position distance to acquire the distance change.In step S1603, the designation interpretation process based on thedistance change is performed to interpret an operation to perform basedon the acquired distance change.

FIG. 17 is a flow diagram showing a process in the step S1602 foracquiring the change in the distance between the designated positionpoints. In step S1701, a distance between the designated position pointsat the start of a travel is measured. In step S1702, a distance betweenthe designated position points at the end of the travel is measured. Insuccession, step S1703 determines a difference between the distancebetween the designated position points at the start of the travel andthe distance between the designated position points at the end of thetravel.

FIG. 18 is a flow diagram showing a designation interpretation processin the step S1603 based on the change in the distance between thedesignated position points. When the amount of change in the distance issmaller than zero in step S1801, the designation is interpreted as acontraction operation (in step S1802). When the amount of change isgreater than zero, the designation is interpreted as an expansionoperation (in step S1803). When the amount of change is equal to zero,the designation is interpreted as an operation other than thecontraction and expansion operations (in step S1804).

FIG. 19 is a flow diagram showing another designation interpretationprocess based on the change in the distance between the designatedposition points. In step S1901, an operational magnification is acquiredfrom the distance change obtained in the process of acquiring thedistance change between the designated position points. In step S1902,the rate of change is acquired, and in step S1903, an effectivemagnification results from the operational magnification and rate ofchange data in accordance with the following equation.

Effective magnification=100−(100−operational magnification X)×rate ofchange α

FIGS. 20A and 20B show an operational example that is interpreted as acontraction operation. As shown, designated position points A and B atthe start time t₁ of a travel are respectively shifted to designatedposition points A′ and B′ at the end time t₅ of the travel. This inputis interpreted as a contraction operation.

FIGS. 21A and 21B show the corresponding data samples that areinterpreted as the contraction operation. In a graph 2101, the XYcoordinates of the designated position points are At₁(3,3) andBt₁(12,10) at the start time t₁ and At₅(7,5) and Bt₅(8,6) at the endtime t₅ of the travel. Referring to a table 2102, the distance betweenthe designated points is 15.00 at the start time t₁, and is 1.118 at theend time t₅. The mount of change in the distance between the designatedposition points is −13.882 from the start time t₁ to the end time t₅.The magnification of the distance change between the designated positionpoints from the start time t1 to the end time t₅ is 7%.

FIGS. 22A and 22B show an operational example that is interpreted as anexpansion operation. As shown, designated position points A and B at thestart time t₁ of a travel are respectively shifted to designatedposition points A′ and B′ at the end time t₅ of the travel. This inputis interpreted as an expansion operation.

FIGS. 23A and 23B show the corresponding data samples that areinterpreted as the expansion operation. In a graph 2301, the XYcoordinates of the designated position points are At₁(7,5) and Bt₁(8,6)at the start time t₁ and At₅(3,3) and Bt₅(12,10) at the end time t₅ ofthe travel. Referring to a table 2302, the distance between thedesignated points at the start time t₁ is 1.118, and 11.402 at the endtime t₅. The mount of change in the distance between the designatedposition points is +13.586 from the start time t₁ to the end time t₅.The magnification of the distance change between the designated positionpoints from the start time t₁ to the end time t₅ is 1020%.

Third Embodiment

A third embodiment of the present invention is now discussed. The thirdembodiment accounts for a change in an angle made between a referenceline and a line that connects two designated positions when an operationto perform is interpreted from a combination of travel paths of at leasttwo designated positions. The angle made between the reference line andthe line that connects the two designated positions is hereinafteroccasionally referred to as the designated position angle.

FIG. 24 is a flow diagram showing a designation interpretation processusing a change in the angle of designated positions. In step S2401, aprocess for measuring the designated position angle is initiated. Ateach time point, the designated position angle is measured. Thealgorithm proceeds to step S2402. An acquisition process of acquiring achange in the designated position angle is performed. In step S2403, adesignation interpretation process is initiated to interpret anoperation to perform based on the acquired angle change.

FIG. 25 is a flow diagram showing the process for acquiring the changein the angle of the designated position. In step S2501, an angle of aline connecting the designated positions is measured at the start of atravel, and in step S2502, an angle of a line connecting the designatedA and B is 60 degrees with respect to the X axis at the start time t₁ ofthe travel and is 26 degrees with respect to the X axis at the end timet₅ of the travel. As listed in a table 2802, the amount of change in theangle from the start time t₁ of the travel to the end time t₅ of thetravel is −34°.

FIGS. 29A and 29B show an operational example that is interpreted as acounterclockwise rotation operation. As shown, designated positionpoints A and B at the start time t₁ of the travel are respectivelyshifted to designated position points A′ and B′ at the end time t₅ ofthe travel. This input is interpreted as a counterclockwise rotationoperation.

FIGS. 30A and 30B show the corresponding data samples that areinterpreted as the counterclockwise rotation operation. In a graph 3001,the angle of the designated position point points A and B is 60 degreeswith respect to the X axis at the start time t₁ of the travel and is 87degrees with respect to the X axis at the end time t₅ of the travel. Aslisted in a table 3002, the amount of change in the angle from the starttime t₁ of the travel to the end time t₅ of the travel is +27°.

Fourth Embodiment

A fourth embodiment of the present invention is now positions ismeasured at the end of the travel. The algorithm proceeds to step S2503.A difference between the angles of the line connecting the designatedposition points at the start of the travel and the line connecting thedesignated position points at the end of the travel is acquired.

FIG. 26 is a flow diagram showing a designation interpretation processbased on the angle change. When the amount of change is greater thanzero degree in step S2601, the designation is interpreted as acounterclockwise rotation operation (in step S2602). When the amount ofchange is smaller than zero degree in the step S2601, the designation isinterpreted as a clockwise rotation operation (in step S2603). When theamount of change equals zero degree, the designation is interpreted asan operation other than rotation operations (in step S2604).

FIGS. 27A and 27B show an operational example that is interpreted as aclockwise rotation operation. As shown, designated position points A andB at the start time t₁ of the travel are respectively shifted todesignated position points A′ and B′ at the end time t₅ of the travel.This input is interpreted as a clockwise rotation operation.

FIGS. 28A and 28B show the corresponding data samples that areinterpreted as the clockwise rotation operation. In a graph 2801, theangle of the designated position points discussed. The fourth embodimentaccounts for a change in a relationship between a designated fixedposition and a designated moving position when an operation to performis interpreted from a combination of travel paths of at least twodesignated position points.

FIG. 31 is a flow diagram showing a designation interpretation processthat uses a relationship between a designated fixed position and adesignated moving position. In step S3101, a designated fixed positiondetection process is initiated to detect a designated fixed position. Insuccession, step S3102 initiates a designation interpretation process inresponse to the designated fixed position to interpret an operation toperform.

FIG. 32 is a flow diagram showing the designated fixed positiondetection process. When the designated fixed position detection processis initiated, a designated position at time t is detected in step S3201.When position data is present in step S3202, the algorithm proceeds tostep S3203 to compare the current designated position with an initialvalue of the designated position. When both are unmatched, thedesignated position is determined to be as being shifted in step S3204.When the designate position at time t matches the initial value thereof,the algorithm proceeds to step S3205 to advance time t, and then theabove series of steps starts again with the step S3201. When no positiondata is available in the step S3202, the designated position isdetermined to be fixed, and the designated fixed position is thendetected.

FIG. 33 is a flow diagram showing a designation interpretation processbased on the direction of travel. In step S3301, a process is initiatedto determine the travel direction of the designated position. In stepS3302, an operation to perform is interpreted based on the determinedtravel direction of the designated position.

When the travel direction is upward, the algorithm proceeds to stepS3303, thereby interpreting the designation as a next-item operation.Besides the next-item operation, the designation may be interpreted asone of a next-page operation, a next-screen operation, a last-lineoperation, an upward shifting operation, an expansion operation in avertical direction only, and a contraction operation in a verticaldirection only. When the travel direction is downward, the algorithmproceeds to step S3304, thereby interpreting the designation as one of apreceding-item operation. Besides the preceding-item operation, thedesignation may be interpreted as a preceding-page operation, apreceding-screen operation, a first-line operation, a downward shiftingoperation, an expansion operation in a vertical direction only, and acontraction operation in a vertical direction only.

When the travel direction is leftward, the algorithm proceeds to stepS3305, thereby interpreting the designation as a next-item operation.Besides the next-item operation, the designation may be interpreted asone of a next-page operation, a next-screen operation, a last-lineoperation, a leftward screen shifting operation, an expansion operationin a lateral direction only, and a contraction operation in a lateraldirection only. When the travel direction is rightward, the algorithmproceeds to step S3306, thereby interpreting the designation as apreceding-item operation. Besides the preceding-item operation, thedesignation may be interpreted as one of a preceding-page operation, apreceding-screen operation, a first-line operation, a rightward screenshifting operation, an expansion operation in a lateral direction only,and a contraction operation in a lateral direction only.

FIG. 34 is a flow diagram showing the process of determining thedirection of travel of the designated position point in step S3301. Instep S3401, the distance of travel of the designated position point isacquired in step S3401. In step S3402, the direction of travel isdetermined from the current coordinates of the designated movingposition. In this case, the arctangent of the current coordinates (X,Y)of the designated moving position is determined and the unit of measureis converted from radian to degree.

FIG. 35 illustrates the interpretation of angles used in the designatedposition travel direction determination process. As shown in a diagram3501, the angle range of 360° is divided into two zones with respect tothe X axis: one zone ranges from 0° to 180° in the positive Y axis areaand the other ranges from −1° to −179° in the negative Y axis area.

An angle segment having a range of ±35° (from −35° to 35°) with respectto 0° is interpreted as a rightward direction range. An angle segmenthaving a range of ±35° (from 55° to 125°) with respect to 90° isinterpreted as an upward direction range. An angle segment having arange of ±35° (from 145° to 180° and from −179° to −145°) with respectto 180° is interpreted as a leftward direction range. An angle segmenthaving a range of ±35° (from −55° to −125°) with respect to −90° isinterpreted as a downward direction range. Angle ranges of ±10°respectively with respect to 45°, 135°, −135°, and −45° are used forother operations.

FIGS. 36A and 36B show an operational example that is interpreted as aleftward shifting operation. When the designated position point A isfixed with the designated position point B being moved from Bt₁ to Bt₅,the input is designated as a leftward shifting operation.

FIGS. 37A-37D show the corresponding data samples that are interpretedas the leftward shifting operation. As shown in a graph 3701, thedesignated fixed position has the coordinates thereof at point A(3,3).The designated moving position has the coordinates thereof at pointBt₁(6,3) at travel start time t₁ and at point Bt₅(4,2) at travel endtime t₅. Tables 3702 list position data of the designated fixed positionpoint A and the designated moving position point B from time t₁ to timet₅. A table 3703 lists designated position travel data. The traveldistance of the designated fixed position point A at the travel end timet₅ is zero. The designated moving position point B has a distance oftravel of 2.236 and a direction of travel of −135.43°.

FIGS. 38A and 38B show an operational example that is interpreted as anupward shifting operation. As shown, the designated position point A isfixed while the designated position point B is being moved from Bt₁ toBt₅. This input is interpreted as an upward shifting operation.

FIGS. 39A-39D show the corresponding data samples that are interpretedas the upward shifting operation. As shown in a graph 3901, thedesignated fixed position has the coordinates thereof at point A(6,6).The designated moving position has the coordinates thereof at pointBt₁(5,1) at travel start time t₁ and at point Bt₅(7,4) at travel endtime t₅. Tables 3902 list position data of the designated fixed positionpoint A and the designated moving position point B from time t₁ to timet₅. A table 3903 lists designated position travel data. The traveldistance of the designated fixed position point A at the travel end timet₅ is zero. The designated moving position point B has a distance oftravel of 3.603 and a direction of travel of −56.31°.

FIGS. 40A and 40B show an operational example that is interpreted as adownward shifting operation. As shown, the designated position point Ais fixed while the designated position point B is being moved from Bt₁to Bt₅. This input is interpreted as a downward shifting operation.

FIGS. 41A-41D show the corresponding data samples that are interpretedas the downward shifting operation. As shown in a graph 4101, thedesignated fixed position A has the coordinates thereof at point A(3,3).The designated moving position B has the coordinates thereof at pointBt₁(5,8) at travel start time t₁ and at point Bt₅(5,5) at travel endtime t₅. Tables 4102 list position data of the designated fixed positionpoint A and the designated moving position point B from time t₁ to timet₅. A table 4103 lists designated position travel data. The traveldistance of the designated fixed position point A at the travel end timet₅ is zero. The designated moving position point B has a distance oftravel of 3.000 and a direction of travel of −90°.

FIGS. 42A and 42B show an operational example that are interpreted as arightward shifting operation. As shown, the designated position point Ais fixed while the designated position point B is being moved from Bt₁as shown FIG. 42A to Bt₅ as shown in FIG. 42B. This input is interpretedas a rightward shifting operation.

FIGS. 43A-43D show the corresponding data samples that are interpretedas the rightward shifting operation. As shown in a graph 4301, thedesignated fixed position A has the coordinates thereof at point A(6,6).The designated moving position B has the coordinates thereof at pointBt₁(2,6) at travel start time t₁ and at point Bt₅(5,5) at travel endtime t₅. Tables 4302 list position data of the designated fixed positionpoint A and the designated moving position point B from time t₁ to timet₅. A table 4303 lists designated position travel data. The traveldistance of the designated fixed position point A at the travel end timet₅ is zero. The designated moving position point B has a distance oftravel of 3.162 and a direction of travel of −18.43°.

Fifth Embodiment

A fifth embodiment of the present invention is now discussed. The fifthembodiment accounts for a change in a distance between a designatedfixed position and a designated moving position when an operation toperform is interpreted from a combination of travel paths of at leasttwo designated positions.

FIG. 44 is a flow diagram showing a designation interpretation processthat uses the change in the distance between the designated fixedposition and the designated moving position. A process is initiated tomeasure the distance between the designated fixed position and thedesignated moving position in step S4401. In step S4402, a process ofacquiring a change in the designated position-to-position distance isperformed to acquire the distance change. In step S4403, the designationinterpretation process is initiated based on the acquired distancechange, thereby interpreting what operation to perform.

FIG. 45 is a flow diagram showing, in step S4403, the designationinterpretation process that uses the change in the distance between thedesignated positions. The amount of change is determined in step S4501.When the amount of change is found to decrease, the input is interpretedas a contraction operation (in step S4502). When the amount of change isfound to increase, the input is interpreted as an expansion operation(in step S4503).

FIGS. 46A and 46B show an operational example that is interpreted as acontraction operation. As shown, the designated position point A isfixed while the designated position point B is being moved from Bt₁ toBt₅ toward the designated fixed position A. This input is interpreted asa contraction operation.

FIGS. 47A-47D show the corresponding data samples that are interpretedas the contraction operation. As shown in a graph 4701, the designatedfixed position A has the coordinates thereof at point A(3,3). Thedesignated moving position B has the coordinates thereof at pointBt₁(6,3) at travel start time t₁ and at point Bt₅(4,2) at travel endtime t₅. Tables 4702 list position data of the designated fixed positionpoint A and the designated moving position point B from time t₁ to timet₅. A table 4703 lists data of a change in the distance between thedesignated positions. The position-to-position distance between thepoints A and B is 3.000 at the travel start time t₁ and is 1.414 at thetravel end time t₅. The magnification of the position-to-positiondistance between the points A and B is 47% from time t₁ to time t₅.

FIGS. 48A and 48B show an operational example that is interpreted as anexpansion operation. As shown, the designated position point A is fixedwhile the designated position point B is being moved from Bt₁ to Bt₅ ina direction away from the designated fixed position A. This input isinterpreted as an expansion operation.

FIGS. 49A-49D show the corresponding data samples that are interpretedas the contraction operation. As shown in a graph 4901, the designatedfixed position A has the coordinates thereof at point A(3,3). Thedesignated moving position B has the coordinates thereof at pointBt₁(4,2) at travel start time t₁ and at point Bt₅(6,3) at travel endtime t₅. Tables 4902 list position data of the designated fixed positionpoint A and the designated moving position point B from time t₁ to timet₅. A table 4903 lists data of a change in the distance between thedesignated positions. The position-to-position distance between thepoints A and B is 1.414 at the travel start time t₁ and 3.000 at thetravel end time t₅. The magnification of the position-to-positiondistance change between the points A and B is 212% from time t₁ to timet₅.

FIGS. 50A and 50B show an operational example that is interpreted as acontraction operation centered on a designated fixed position. As shown,the designated position A is fixed. As shown, a designated fixedposition A remains stationary, and designated moving position points Band C are respectively moved from Bt₁ and Ct₁ to Bt₅ and Ct₅. This inputis interpreted as a contraction operation toward the designated fixedposition point A.

FIGS. 51A-51F show the corresponding data samples that is interpreted asthe contraction operation centered on the designated fixed position. Asshown in a graph 5101, a designated fixed position A has the coordinatesthereof at point A(3,3). A designated moving position 1 as the point Bhas the coordinates thereof at point Bt₁(4,8) at travel start time t₁and at point Bt₅(5,5) at travel end time t₅. A designated movingposition 2 as the point C has the coordinates thereof at point Ct₁(2,2)at the travel start time t₁ and at point Ct₅(4,3.5) at the travel endtime t₅. Tables 5102 list position data of the designated fixed positionpoint A, the designated moving position 1 (the point B) and thedesignated moving position 2 (the point C) from time t₁ to time t₅.

Tables 5103 list data of the change in the distance between thedesignated positions. In data 1 of the change in the designatedposition-to-position distance, the distance between the points A and Bis 5.099 at the travel start time t₁ and is 2.828 at the travel end timet₅. The magnification resulting from the position-to-position distancechange between the points A and B is 55% from time t₁ to time t₅. Indata 2 of the change in the designated position-to-position distance,the distance between the points A and C is 1.414 at the travel starttime t₁ and is 1.118 at the travel end time t₅. The magnificationresulting from the position-to-position distance change between thepoints A and C is 79% from time t₁ to time t₅.

Sixth Embodiment

A sixth embodiment of the present invention is now discussed. The sixthembodiment accounts for the presence of a designated fixed position anda change in a distance between designated moving positions when anoperation to perform is interpreted from a combination of travel pathsof at least two designated positions.

FIG. 52 is a flow diagram showing an algorithm that uses a distancebetween designated moving positions. In succession to the initiation ofa designated fixed-position based designation interpretation process, aprocess of acquiring the distance between the designated movingpositions is initiated in step S5201. In step S5202, a process ofacquiring the change in the distance between the designated movingpositions is initiated, thereby acquiring the change in the distance. Instep S5203, a designation interpretation process based on the distancechange between the designated moving positions is initiated, thusinterpreting the input based on the amount of change in the distancebetween the designated moving positions.

FIG. 53 is a flow diagram showing the designation interpretation processbased on the change in the distance between the designated movingpositions. When there is a designated fixed position in step S5301, thealgorithm proceeds to step S5302. When the amount of change is smallerthan zero, the input is interpreted as a contraction operation withrespect to the designated fixed position in step S5303. When the amountof change is greater than zero, the input is interpreted as an expansionoperation with respect to the designated fixed position in step S5304.When the amount of change equals zero, the input is interpreted as anoperation other than the contraction and expansion operations in stepS305. When the presence of the designated fixed position is not verifiedin the step S5301, the algorithm proceeds to step S5306 and the input isthus interpreted as an operation effective on the entire screen.

FIGS. 54A and 54B show an operational example that is interpreted as acontraction operation. A designated position point A is fixed while twodesignated moving positions Bt₁ and Ct₁ respectively move to Bt₅ and Ct₅toward the designated fixed position A. The input is thus interpreted asa contraction operation centered on the designated fixed position A inaccordance with the amount of change in the distance between thedesignated moving positions.

FIGS. 55A-55E show the corresponding data samples that are interpretedas the contraction operation. In a graph 5501, the designated fixedposition has the coordinates thereof at point A(3,3). The designatedmoving position B has the coordinates thereof at point Bt₁(4,8) attravel start time t₁ and at point Bt₅(5,5) at travel end time t₅. Thedesignated moving position point C has the coordinates thereof at pointCt₁(3,2) at the travel start time t₁ and at point Ct₅(4,2.8) at thetravel end time t₅.

Tables 5502 list position data of the designated fixed position point A,the designated moving position point B, and the designated movingposition point C from time t₁ to time t₅. A table 5503 lists data of thechange in the distance between the designated moving positions. In thedata of the distance change between the designated moving positions, thedistance between the designated position points B and C is 6.083 at thetravel start time t₁ and is 2.417 at the travel end time t₅. Themagnification resulting from the distance change between the designatedposition points B and C is 40% from time t₁ to time t₅.

FIGS. 56A and 56B show an operational example that is interpreted as anexpansion operation centered on the designated fixed position. Adesignated position point A is fixed while two designated movingpositions Bt₁ and Ct₁ respectively move to Bt₅ and Ct₅ in a directionaway from the designated fixed position A. The input is thus interpretedas an expansion operation centered on the designated fixed position A inaccordance with the amount of change in the distance between thedesignated moving positions.

FIGS. 57A-57E show the corresponding data samples that are interpretedas the expansion operation centered on the designated fixed position. Ina graph 5701, the designated fixed position has the coordinates thereofat point A(3,3). The designated moving position 1 (the point B) has thecoordinates thereof at point Bt₁(5,5) at travel start time t₁ and atpoint Bt₅(4,8) at travel end time t₅. The designated moving position 2(the point C) has the coordinates thereof at point Ct₁(4,2.8) at thetravel start time t₁ and at point Ct₅(2,2) at the travel end time t₅.

Tables 5702 list position data of the designated fixed position point A,the designated moving position 1 (the point B), and the designatedmoving position 2 (the point C) from time t₁ to time t₅. A table 5703lists data of the change in the distance between the designated movingpositions. In the data 1 of the distance change between the designatedmoving positions, the distance between the designated position points Band C is 2.417 at the travel start time t₁ and is 6.325 at the travelend time t₅. The magnification resulting from the distance changebetween the designated position points B and C is 262% from time t₁ totime t₅.

FIGS. 58A and 58B show an operational example that are interpreted as anoperation for moving a plurality of positions with respect to adesignated fixed position. As shown, a designated position point A isfixed. A designated moving position 1, a designated moving position 2and a designated moving position 3, which are respectively positioned ata point Bt₁, a point Ct₁, and a point Dt₁ as shown in FIG. 58A at travelstart time t₁, are respectively moved to a point Bt₅, a point Ct₅, and apoint Dt₅ as shown in FIG. 58B toward the designated fixed position A attravel end time t₅. The input is thus interpreted as an operation formoving the plurality of designated position points toward the designatedfixed position A according to the amount of change in the distancebetween the designated moving positions.

FIGS. 59A-59H show the corresponding data samples that are interpretedas the operation for moving the plurality of positions. In a graph 5901,the designated fixed position is placed at coordinates A(3,3). Thedesignated moving position 1 (the point B) is placed at coordinatesBt₁(5,5) at the travel start time t₁ and at coordinates Bt₅(4,8) at thetravel end time t₅. The designated moving position 2 (the point C) isplaced at coordinates Ct₁(4,3.5) at the travel start time t₁ and atCt₅(2,2) at the travel end time t₅. The designated moving position 3(the point D) is placed at coordinates Dt₁(5.5,4.5) at the travel starttime t₁ and at coordinates Dt₅(6,9) at the travel end time t₅.

Tables 5902 list position data of the designated fixed position A, andthe three designated moving positions B, C, and D. Tables 5903 listchanges in the distances between the designated moving positions. Indata 1 of the distance change, the distance between the designatedposition points B and C is 1.803 at the travel start time t₁, and is6.325 at the travel end time t₅. The magnification resulting from thedistance change between the designated positions is 352% from time t₁ totime t₅. In data 2 of the distance change, the distance between thedesignated position points B and D is 0.707 at the travel start time t₁,and is 2.236 at the travel end time t₅. The magnification resulting fromthe distance change between the designated position points is 316% fromtime t₁ to time t₅. In data 2 of the distance change, the distancebetween the designated position points C and D is 1.803 at the travelstart time t₁, and is 8.062 at the travel end time t₅. The magnificationresulting from the distance change between the designated positionpoints is 447% from time t₁ to time t₅.

Seventh Embodiment

A seventh embodiment of the present invention is now discussed. Theseventh embodiment accounts for a change in an angle made between ahorizontal direction and a line that connects a designated fixedposition and a designated moving position when an operation to performis interpreted from a combination of travel paths of at least twodesignated position points. The angle is hereinafter referred to as afixed-to-moving position angle.

FIG. 60 is a flow diagram of an algorithm that uses a change in theangle of the designated fixed and moving positions. In step S6001, aprocess is performed to measure the fixed-to-moving position angle. Instep S6002, a process is performed to acquire a change in thefixed-to-moving position angle. In step S6003, a designationinterpretation process is performed to interpret the input based on theacquired angle change.

FIG. 61 is a flow diagram showing the designation interpretation processbased on the change in the fixed-to-moving position angle. When there isno designated fixed position in step S6101, the algorithm proceeds tostep S6106. The input is interpreted as an operation for the entirescreen. When any designated fixed position is found in the step S6106,the algorithm proceeds to step 6102. When the amount of change issmaller than zero degree, the algorithm proceeds to step S6104, and theinput is interpreted as a clockwise rotation operation about thedesignated fixed position. When the amount of change is greater thanzero degree, the algorithm proceeds to step S6103, and the input isinterpreted as a counterclockwise rotation operation about thedesignated fixed position. When the amount of change equals zero degree,the algorithm proceeds to step S6105, and the input is interpreted as anoperation other than rotation operations, or a modified operation in arotational direction with the designated fixed position stationary.

FIGS. 62A and 62B show an operational example that is interpreted as aclockwise rotation operation. As shown, a designated position point A isfixed while a designated moving position B moves from a point Bt₁ attravel start time t₁ to a point Bt₅ at travel end time t₅. This input isinterpreted as a clockwise rotation operation.

FIGS. 63A-63D show the corresponding data samples that are interpretedas the clockwise rotation operation. In a graph 6301, the angle of theline connecting the designated fixed position A and the designatedmoving position B with respect to the horizontal line is 71.57° at thetravel start time t₁ and is 18.43° at the travel end time t₅. Tables6302A and 6302B list position data of the designated fixed position Aand the designated moving position B. A table 6303 lists angle changedata of the designated position points, in which the amount of change inthe fixed-to-moving position angle from the travel start time t₁ to thetravel end time t₅ is −53.13°.

FIGS. 64A and 64B show an operational example that is interpreted as acounterclockwise rotation operation. As shown, a designated positionpoint A is fixed while a designated moving position B moves from a pointBt₁ at travel start time t₁ to a point Bt₅ at travel end time t₅. Thisinput is interpreted as a counterclockwise rotation operation.

FIGS. 65A-65D show the corresponding data samples that are interpretedas the counterclockwise rotation operation. In a graph 6501, the angleof the line connecting the designated fixed position A and thedesignated moving position B with respect to the horizontal line is71.57° at the travel start time t₁ and is 108.43° at the travel end timet₅. Tables 6502A and 6502B list position data of the designated fixedposition A and the designated moving position B. A table 6503 listsangle change data of the designated position points, in which the amountof change in the fixed-to-moving position angle from the travel starttime t₁ to the travel end time t₅ is +36.87°.

Eighth Embodiment

An eight embodiment of the present invention is now discussed. Theeighth embodiment accounts for a change in an angle made between ahorizontal direction and a line that connects two designated movingpositions when an operation to perform is interpreted from a combinationof travel paths of at least two designated position points. The angle ishereinafter referred to as a moving-to-moving position angle.

FIG. 66 is a flow diagram of an algorithm that uses a change in themoving-to-moving position angle. In step S6601, a process is performedto measure the moving-to-moving position angle. In step S6602, a processis performed to acquire a change in the moving-to-moving position angle.In step S6603, a designation interpretation process is performed tointerpret the input based on the acquired angle change.

FIG. 67 is a flow diagram of the designation interpretation processbased on the change in the moving-to-moving position angle. When nodesignated fixed position is found in step S6701, the algorithm proceedsto step S6706. The input is then interpreted as an operation effectiveon the entire screen. When a designated fixed position is found in thestep S6701, the amount of change is checked in step S6702. When theamount of change is smaller than zero degree, the algorithm proceeds tostep S6704, and the input is interpreted as a clockwise rotationoperation about the designated fixed position. When the amount of changeis greater than zero degree, the algorithm proceeds to step S6703, andthe input is interpreted as a counterclockwise rotation operation aboutthe designated fixed position. When the amount of change equals zerodegree, the algorithm proceeds to step S6705, and the input isinterpreted as an operation other than rotation operations. Otherwise,the input is interpreted as a modified operation in a rotation directionabout the center of gravity of the designated moving positions with thedesignated fixed position stationary.

FIGS. 68A and 68B show an operational example that is interpreted as theclockwise rotation operation. As shown, a designated position point A isfixed while designated moving positions 1 and 2 respectively move from apoint Bt₁ and a point Ct₁ to a point Bt₅ and a point Ct₅. This input isinterpreted as a clockwise rotation operation.

FIGS. 69A-69E show the corresponding data samples that are interpretedas the clockwise rotation operation. In a graph 6901, the designatedfixed position A has coordinates A(3,3). The designated moving positionB is placed at coordinates Bt₁(4,6) at the travel start time t₁ andplaced at coordinates Bt₅(6,4) at the travel end time t₅. The designatedmoving position C is placed at coordinates Ct₁(2,1) at the travel starttime t₁ and placed at coordinates Ct₅(1,2) at the travel end time t₅.Tables 6902 list position data of the designated fixed position A, thedesignated moving position 1 (the point B), and the designated movingposition 2 (the point C) from t₁ to t₅. A table 6903 lists data of anglechange in the moving-to-moving position angle. In the angle change data,the moving-to-moving position angle is 68.20° at the travel start timet₁ and is 36.87° at the travel end time t₅. The amount of change in themoving-to-moving position angle is −31.33°.

FIGS. 70A and 70B show an operational example that is interpreted as acounterclockwise rotation operation. As shown, a designated positionpoint A is fixed while designated moving positions B and C respectivelymove from a point Bt₁ and a point Ct₁ to a point Bt₅ and a point Ct₅.This input is interpreted as a counterclockwise rotation operation.

FIGS. 71A-71E show the corresponding data samples that are interpretedas the counterclockwise rotation operation. In a graph 7101, thedesignated fixed position A has coordinates A(3,3). The designatedmoving position B is placed at coordinates Bt₁(4,6) at the travel starttime t₁ and placed at coordinates Bt₅(2,5) at the travel end time t₅.The designated moving position C is placed at coordinates Ct₁(2,1) atthe travel start time t₁ and placed at coordinates Ct₅(2.5,2) at thetravel end time t₅. Tables 7102 list position data of the designatedfixed position point A, the designated moving position point B, and thedesignated moving position point C from t₁ to t₅. A table 7103 listsdata of angle change in the moving-to-moving position angle. In theangle change data, the moving-to-moving position angle is 68.20° at thetravel start time t₁ and is 99.46° at the travel end time t₅. The amountof change in the moving-to-moving position angle is +31.26°.

FIGS. 72A and 72B show an operational example that is interpreted as arotation operation about the center of gravity of three designatedmoving positions. As shown, a designated position point A is fixed whiledesignated moving positions B, C, and D respectively move from a pointBt₁, a point Ct₁, and a point Dt₁ to a point Bt₅, a point Ct₅, and apoint Dt₅. This input is interpreted as the rotation operation about thecenter of gravity.

FIGS. 73A-73H show the corresponding data samples that are interpretedas the rotation operation about the center of gravity. In a graph 7301,the designated fixed position A has coordinates A(3,3). The designatedmoving position B is placed at coordinates Bt₁(5,5) at the travel starttime t₁ and placed at coordinates Bt₅(4,8) at the travel end time t₅.The designated moving position C is placed at coordinates Ct₁(4,3.5) atthe travel start time t₁ and placed at coordinates Ct₅(2,2) at thetravel end time t₅. The designated moving position D is placed atcoordinates Dt₁(5.5, 4.5) at the travel start time t₁ and placed atcoordinates Dt₅(6,9) at the travel end time t₅. Tables 7302 listposition data of the designated fixed position point A, the designatedmoving position point B, the designated moving position point C, and thedesignated moving position point D from t₁ to t₅. Table 7303 list dataof distance change between the designated moving positions. In thedistance change data, the distance change between the designated movingpositions B and C is 1.803 at the travel start time t₁ and is 6.325 atthe travel end time t₅. The magnification resulting from the distancechange therebetween is 351%. The distance change between the designatedmoving positions B and D is 0.707 at the travel start time t₁ and is2.236 at the travel end time t₅. The magnification resulting from thedistance change therebetween is 316%. The distance change between thedesignated moving positions C and D is 1.803 at the travel start time t₁and is 8.062 at the travel end time t₅. The magnification resulting fromthe distance change therebetween is 447%.

Ninth Embodiment

A ninth embodiment of the present invention is now discussed. The ninthembodiment accounts for a positional relationship between a plurality ofdesignated positions when an operation to perform is interpreted from acombination of travel paths of at least two designated positions.

FIG. 74 is a flow diagram showing an algorithm that uses a positionalrelationship between designated positions. In step S7401, a process isperformed to acquire the positional relationship between the designatedpositions. In step S7402, a designation interpretation process isperformed to interpret the input based on the acquired positionalrelationship between the plurality of designated positions.

FIG. 75 is a flow diagram showing, in the step S7401, the process fordetermining the positional relationship between designated positions. Instep S7501, the angle of the designated positions is acquired. When theacquired angle is found to be within a range of from 45° to 135° withrespect to 90° or a range of from −45° to −135° with respect to −90° instep S7502, the positional relationship between the designated positionpoints is vertically upward or downward. When the acquired angle isfound to be within a range of from 45° to −45° with respect to 0° or arange of from 135° to −135° with respect to 180° in step S7502, therelationship between the designated position points is laterallyrightward or leftward. The interpretation of angle is alreadyillustrated in FIG. 35.

FIG. 76 is a flow diagram showing, in the step S7402, the designationinterpretation process based on the positional relationship between thedesignated position points. In step S7601, a process is performed toacquire an area of travel. In step S7602, the positional relationship isinterpreted. When the positional relationship is vertically upward ordownward, the algorithm proceeds to step S7603. The input is thusinterpreted as a command for one of a cutting operation and a deletingoperation. When the positional relationship is laterally rightward orleftward, the algorithm proceeds to step S7604. The input is thusinterpreted as a command for a copying operation.

FIG. 77 shows an operational example that is interpreted as avertical-relationship translation operation. As shown, designatedposition points A and B respectively move from At₁ and Bt₁ to At₅ andBt₅. The input is thus interpreted as a vertical-relationshiptranslation operation.

FIGS. 78A-78D show the corresponding data samples that are interpretedas the vertical-relationship translation operation. In a graph 7801, theangle t₁ representing the relationship of the designated positions is108.43° when the designated positions A and B respectively are placed atcoordinates At₁(4,5) and coordinates Bt₁(3,8) at travel start time t₁.The angle t₅ representing the relationship of the designated positionsis 108.43° when the designated position points A and B are respectivelyplaced at coordinates A_(t)5(8,5) and at coordinates Bt₅(7,8) at travelend time t₅. Tables 7802 list position data of the designated positionpoint A and the designated position point B from time t₁ to time t₅. Atable 7803 lists data of the positional relationship between thedesignated positions, namely, the angles of the lines connecting thedesignated positions with respect to the horizontal line from time t₁ totime t₅.

FIGS. 79A and 79B show an operational example that is interpreted as alateral relationship translation operation. As shown, designatedposition points A and B respectively move from At₁ and Bt₁ to At₅ andBt₅. The input is thus interpreted as a lateral-relationship translationoperation.

FIGS. 80A-80D show the corresponding data samples that are interpretedas the lateral-relationship translation operation. In a graph 8001, theangle t₁ representing the relationship of the designated positions is26.57° when the designated position points A and B respectively areplaced at coordinates At₁(3,8) and coordinates Bt₁(5,9) at travel starttime t₁. The angle t₅ representing the relationship of the designatedpositions is 26.57° when the designated position points A and B arerespectively placed at coordinates At₅(7,8) and at coordinates Bt₅(9,9)at travel end time t₅. Tables 8002 list position data of the designatedposition point A and the designated position point B from time t₁ totime t₅. A table 8003 lists data of the positional relationship betweenthe designated position points, namely, the angles of the linesconnecting the designated positions with respect to the horizontal linefrom time t₁ to time t₅.

Tenth Embodiment

A tenth embodiment of the present invention is now discussed. The tenthembodiment accounts for a change in a positional relationship between aplurality of designated positions when an operation to perform isinterpreted from a combination of travel paths of at least twodesignated positions.

FIG. 81 is a flow diagram showing a designation interpretation processbased on a positional relationship between designated positions. In stepS8101, a process is performed to determine a change in the positionalrelationship between the designated positions. In step S8102, adesignation interpretation process is performed to interpret the inputbased on the data of the change in the positional relationship.

FIG. 82 is a flow diagram showing a designation interpretation processbased on the positional relationship between the designated positions.In step S8201, the amount of angle change is checked. When the amount ofangle change is in a direction of inversion, the algorithm proceeds tostep S8202. The input is then interpreted as a command for one of aninversion operation, a deleting operation, and a cutting operation. Whenthe amount of angle change is not in a direction of inversion in thestep S8201, the algorithm proceeds to step S8203. A positional change inthe X direction is checked. When the designated positions are laterallyinverted, the algorithm proceeds to step S8204. The input is interpretedas a command for one of a laterally right-left inverting operation, adeleting operation, and a cutting operation.

When the positional change in the X direction is not laterally invertedin the step S8203, the positional change in the Y direction is checkedin step S8205. When the designated positions are found to be verticallyinverted in the step S8205, the algorithm proceeds to step S8206. Theinput is thus interpreted as a command for one of a vertically up anddown inverting operation, a deleting operation, and a cutting operation.When the designated positions are not vertically inverted in the stepS8205, the algorithm proceeds to step S8207. The input is interpreted asa command for one of an expansion operation, and a contractionoperation.

FIG. 83 is a flow diagram showing an algorithm for acquiring a change inthe positional relationship between the designated positions. In stepS8301, a process is performed to acquire the angle of the designatedpositions. In step S8302, a process is performed to acquire a change inthe angle of the designated positions. When the angle change acquired inthe step S8302 falls within a predetermined range with respect to abilaterally symmetrical direction in step S8303, the algorithm proceedsto step S8304. The positional relationship change between the designatedpositions is interpreted as an inversion operation.

When the acquired angle change is found to fall outside thepredetermined range in step S8303, the algorithm proceeds to step S8305.In step S8305, a process is performed to determine a lateral positionalrelationship between the designated positions. In step S8306, a processis performed to determine a change in the lateral positionalrelationship between the designated positions. The algorithm proceeds tostep S8307. When the acquired change in the lateral positionalrelationship is found to be negative in the step S8307, the algorithmproceeds to step S8308, and the acquired change in the lateralpositional relationship is interpreted as a laterally right and leftinverting operation.

When the acquired change in the lateral positional relationship is foundto be positive in the step S8307, the algorithm proceeds to step S8309.In step S8309, a process is performed to determine a vertical positionalrelationship between the designated positions. In step S8310, a processis performed to determine a change in the vertical positionalrelationship between the designated positions. The algorithm proceeds tostep S8311. When the acquired change in the vertical positionalrelationship is found to be negative in the step S8311, the algorithmproceeds to step S8312. The acquired change in the vertical positionalrelationship is thus interpreted as a vertically up and down invertingoperation. On the other hand, when the acquired change is found to bepositive in the step S8311, the algorithm proceeds to step S8313, andthe positional relationship is thus determined to be free from anychange.

FIGS. 84A and 84B show an operational example that is interpreted as aninversion operation. As shown, designated position points A and Brespectively move from points At₁ and Bt₁ to points At₅ and Bt₅. Thisinput is interpreted as the inversion operation.

FIGS. 85A-85D show the corresponding data samples that are interpretedas the inversion operation. In a graph 8501, the angle t₁ of the lineconnecting the designated position point A to the designated positionpoint B with respect to the horizontal line is 14.04° when thedesignated position points A and B respectively are placed atcoordinates At₁(4,10) and coordinates Bt₁(8,11) at travel start time t₁.The angle t₅ of the line connecting the designated position point A tothe designated position point B is −165.96° when the designated positionpoints A and B are respectively placed at coordinates At₅(8,4) and atcoordinates Bt₅(4,3) at travel end time t₅. Tables 8502 list positiondata of the designated position point A and the designated positionpoint B from time t₁ to time t₅. A table 8503 lists data of thepositional relationship between the designated positions. Specifically,the table 8503 stores the changes in the positional relationship betweenthe designated positions in the X direction, and in the Y direction, andin the angle of the designated positions. In this case, the change inthe positional relationship is 180°, indicating that the designatedposition point A and the designated position point B are inverted inposition.

FIGS. 86A and 86B show an operational example that is interpreted as alateral inversion operation. As shown, the designated position points Aand B respectively move from points At₁ and Bt₁ to points At₅ and Bt₅.This input is interpreted as a laterally right and left invertingoperation.

FIGS. 87A-87D show the corresponding data samples that are interpretedas the lateral inversion operation. In a graph 8701, the angle t₁ of theline connecting the designated position point A to the designatedposition point B with respect to the horizontal line is 71.57° when thedesignated position points A and B respectively are placed atcoordinates At₁(10,10) and coordinates Bt₁(11,13) at travel start timet₁. The angle t₅ of the line connecting the designated position point Ato the designated position point B is 116.57° when the designatedposition points A and B are respectively placed at coordinates At₅(9,3)and at coordinates Bt₅(8,5) at travel end time t₅. Tables 8702 listposition data of the designated position point A and the designatedposition point B from time t₁ to time t₅. A table 8703 lists data of thepositional relationship between the designated positions. Specifically,the table 8703 stores the changes in the positional relationship betweenthe designated positions in the X direction, and in the Y direction, andin the angle of the designated positions. Since the positionalrelationship in the X direction changes from negative to positive inthis case, the designated position points A and B are laterallyinverted.

FIGS. 88A and 88B show an operational example that is interpreted as avertical inversion operation. As shown, the designated position points Aand B respectively move from points At₁ and Bt₁ to points At₅ and Bt₅.This input is interpreted as a vertically up and down invertingoperation.

FIGS. 89A-89D show the corresponding data samples that are interpretedas the vertical inversion operation. In a graph 8901, the angle t₁ ofthe line connecting the designated position point A to the designatedposition point B with respect to the horizontal line is 56.31° when thedesignated position points A and B respectively are placed atcoordinates At₁(5,12) and coordinates Bt₁(7,15) at travel start time t₁.The angle t₅ of the line connecting the designated position point A tothe designated position point B is −45.00° when the designated positionpoints A and B are respectively placed at coordinates At₅(5,2) and atcoordinates Bt₅(6,1) at travel end time t₅. Tables 8902 list positiondata of the designated position point A and the designated positionpoint B from time t₁ to time t₅. A table 8903 lists data of thepositional relationship between the designated positions. Specifically,the table 8903 stores the changes in the positional relationship betweenthe designated positions in the X direction, and in the Y direction, andin the angle of the designated positions. Since the positionalrelationship in the Y direction changes from negative to positive inthis case, the designated position points A and B are vertically up anddown inverted.

Eleventh Embodiment

An eleventh embodiment of the present invention is now discussed. Theeleventh embodiment accounts for a positional relationship between adesignated fixed position and a designated moving position when anoperation to perform is interpreted from a combination of travel pathsof at least two designated positions.

FIG. 90 is a flow diagram showing an algorithm for determining apositional relationship between designated positions. In step S9001, aprocess is performed to detect the designated fixed position. In step9002, a process is performed to determine the positional relationshipbetween the designated fixed position and the designated movingposition.

FIG. 91 is a flow diagram of a designation interpretation process basedon the positional relationship to the designated fixed position. In stepS9101, a process is performed to interpret the input based on thedetermined positional relationship data.

FIG. 92 is a flow diagram showing in detail the designationinterpretation process based on the positional relationship of thedesignated fixed position. In step S9201, a process is performed toacquire the direction of travel of the designated moving position. Instep S9202, the travel direction is determined. When the traveldirection is found to be leftward in the step S9202, the algorithmproceeds to step S9203.

When the positional relationship of the designated moving position isfound to be to the right of the designated fixed position in the stepS9203, the algorithm proceeds to step S9207. The input is interpreted asa command for one of a next-item operation, a next-page operation, anext-screen operation, a last-line operation, and a contractionoperation in a lateral direction only. When the positional relationshipof the designated moving position is found to be the left of thedesignated fixed position in the step S9203, the algorithm proceeds tostep S9208. The input is interpreted as a command for one of a leftwardscreen shifting operation and an expansion operation in a lateraldirection only. When the positional relationship of the designatedmoving position is found to be above the designated fixed position inthe step S9203, the algorithm proceeds to step S9209. The input isinterpreted as a command for a counterclockwise rotation operation. Whenthe positional relationship of the designated moving position is foundto be below the designated fixed position in the step S9203, thealgorithm proceeds to step S9210. The input is interpreted as a commandfor a clockwise rotation operation.

When the travel direction is found to be upward in the step S9202, thealgorithm proceeds to step S9204. When the positional relationship ofthe designated moving position is found to be to the right of thedesignated fixed position in the step S9204, the algorithm proceeds tostep S9211. The input is interpreted as a command for a counterclockwiserotation operation. When the positional relationship of the designatedmoving position is found to be to the left of the designated fixedposition in the step S9204, the algorithm proceeds to step S9212. Theinput is interpreted as a command for a clockwise rotation operation.When the positional relationship of the designated moving position isfound to be above the designated fixed position in the step S9204, thealgorithm proceeds to step S9213. The input is interpreted as a commandfor a screen upward shifting operation or an expansion operation in avertical direction. When the positional relationship of the designatedmoving position is found to be below the designated fixed position inthe step S9204, the algorithm proceeds to step S9214. The input isinterpreted as a command for one of a next-item operation, a next-pageoperation, a next-screen operation, a last-line operation, and acontraction operation in a lateral direction only.

When the travel direction is found to be downward in the step 9202, thealgorithm proceeds to step S9205. When the positional relationship ofthe designated moving position is found to be to the right of thedesignated fixed position in the step S9205, the algorithm proceeds tostep S9215. The input is interpreted as a command for a clockwiserotation operation. When the positional relationship of the designatedmoving position is found to be to the left of the designated fixedposition in the step S9205, the algorithm proceeds to step S9216. Theinput is interpreted as a command for a counterclockwise rotationoperation. When the positional relationship of the designated movingposition is found to be above the designated fixed position in the stepS9205, the algorithm proceeds to step S9217. The input is interpreted asa command for one of a preceding-item operation, a preceding-pageoperation, a preceding-screen operation, a first-line operation, and acontraction operation in a vertical direction only. When the positionalrelationship of the designated moving position is found to be below thedesignated fixed position in the step S9205, the algorithm proceeds tostep S9218. The input is interpreted as a command for a downward screenshifting operation.

When the travel direction is found to be rightward in the step S9202,the algorithm proceeds to step S9206. When the positional relationshipof the designated moving position is found to be to the right of thedesignated fixed position in the step S9206, the algorithm proceeds tostep S9219. The input is interpreted as a command for one of rightwardscreen shifting operation and an expansion operation in a lateraldirection only. When the positional relationship of the designatedmoving position is found to be to the left of the designated fixedposition in the step S9206, the algorithm proceeds to step S9220. Theinput is interpreted as a command for one of a preceding-item operation,a preceding-page operation, a preceding-screen operation, a first-lineoperation, and a contraction operation in a vertical direction only.When the positional relationship of the designated moving position isfound to be above the designated fixed position in the step S9206, thealgorithm proceeds to step S9221. The input is interpreted as a commandfor a clockwise rotation operation. When the positional relationship ofthe designated moving position is found to be below the designated fixedposition in the step S9206, the algorithm proceeds to step S9222. Theinput is interpreted as a command for a counterclockwise rotationoperation.

FIG. 93 is a flow diagram showing an algorithm for determining thepositional relationship to the designated fixed position. In step S9301,a process is performed to acquire an angle of the designated positions.When the acquired angle is found to fall within a predetermined range inan upward direction in step S9302, the positional relationship of thedesignated positions is determined to be upward in step S9303. When theacquired angle is found to fall within a predetermined range in adownward direction in the step S9302, the positional relationship isdetermined to downward in step S9304. When the acquired angle is foundto fall within a predetermined range in a leftward direction in the stepS9302, the positional relationship is determined to be leftward in stepS9305. When the acquired angle is found to fall within a predeterminedrange in a rightward direction in the step S9302, the positionalrelationship is determined to be leftward in step S9306.

FIG. 94 is a flow diagram showing an algorithm for acquiring thedirection of travel of a designated position. As shown, in step S9401, aprocess is performed to acquire the angle of travel of a designatedposition. When the acquired angle is found to fall within apredetermined range in an upward direction in step S9402, the traveldirection relationship of the designated positions is determined to beupward in step S9403. When the acquired angle is found to fall within apredetermined range in a downward direction in the step S9402, thetravel direction is determined to downward in step S9404. When theacquired angle is found to fall within a predetermined range in aleftward direction in the step S9402, the travel direction is determinedto be leftward in step S9405. When the acquired angle is found to fallwithin a predetermined range in a rightward direction in the step S9402,the travel direction is determined to be rightward in step S9406.

FIGS. 95A and 95B show two operational examples that are interpreted asa next-item operation or a leftward screen shifting operation dependingon the positional relationship of designated positions even though thetravel directions thereof are the same. As shown in FIG. 95A, adesignated position point B, placed to the right of a designated fixedposition point A, leftward moves. An operation to perform is interpretedas one of a next-item operation, a next-screen operation, a last-lineoperation, and a contraction operation in a lateral direction only. Onthe other hand, as shown in FIG. 95B, a designated moving position pointD, placed to the left of a designated fixed position point C, leftwardmoves. An operation to perform is interpreted as one of a leftwardscreen shifting operation and an expansion operation in a lateraldirection only.

When the designated moving position point, placed above the designatedfixed position point, leftward moves, an operation to perform isinterpreted as a counterclockwise rotation operation. When thedesignated moving position point, placed below the designated fixedposition point, leftward moves, an operation to perform is interpretedas a clockwise rotation operation.

When the travel direction is upward, the following interpretations arepreformed depending on the positional relationship. With the designatedmoving position point placed to the right of the designated fixedposition point, an operation to perform is interpreted as acounterclockwise rotation operation. With the designated moving positionpoint placed to the left of the designated fixed position point, anoperation to perform is interpreted as a clockwise rotation operation.With the designated moving position placed above the designated fixedposition point, an operation to perform is interpreted as one of anupward screen shifting operation, and an expansion operation in avertical direction only. With the designated moving position pointplaced below the designated fixed position point, an operation toperform is interpreted as a next-item operation, a next-page operation,a next-screen operation, a last-line operation, and a contractionoperation in a vertical direction only.

When the travel direction is downward, the following interpretations arepreformed depending on the positional relationship. With the designatedmoving position point placed to the right of the designated fixedposition point, an operation to perform is interpreted as a clockwiserotation operation. With the designated moving position point placed tothe left of the designated fixed position point, an operation to performis interpreted as a counterclockwise rotation operation. With thedesignated moving position placed above the designated fixed positionpoint, an operation to perform is interpreted as one of a preceding-itemoperation, a preceding-page operation, a preceding-screen operation, afirst-line operation, and a contraction operation in a verticaldirection only. With the designated moving position point placed belowthe designated fixed position point, an operation to perform isinterpreted as one of a downward screen shifting operation and anexpansion operation in a vertical direction only.

When the travel direction is rightward, the following interpretationsare preformed depending on the positional relationship. With thedesignated moving position point placed to the right of the designatedfixed position point, an operation to perform is interpreted as one of arightward screen shifting operation and an expansion operation in alateral direction only. With the designated moving position point placedto the left of the designated fixed position point, an operation toperform is interpreted as a preceding-item operation, a preceding-pageoperation, a preceding-screen operation, a first-line operation, and acontraction operation in a vertical direction only. With the designatedmoving position placed above the designated fixed position point, anoperation to perform is interpreted as a clockwise rotation operation.With the designated moving position point placed below the designatedfixed position point, an operation to perform is interpreted as acounterclockwise rotation operation.

FIGS. 96A-96D show the corresponding data samples that are interpretedas a next-item operation. In a graph 9601, a designated fixed positionpoint A remains stationary at A(3,3), a designated moving position pointB is placed at Bt₁(6,2.8) at travel start time t₁ and at Bt₅(4,2) attravel end time t₅. Tables 9602 list position data of the designatedfixed position point A and the designated moving position point B fromtime t₁ to time t₅. A table 9603 lists the positional relationshipbetween the designated fixed position and the designated movingposition. As listed, at the travel end time t₅, the designated fixedposition point A has a distance of travel of zero, and the designatedmoving position point B has a distance of travel of 2.236. Thepositional relationship between the designated fixed position A and thedesignated moving position B is changed from 176.19° at the travel starttime t₁ to 135.00° at the travel end time t₅. The direction of travel ofthe designated moving position point B is −153.43°.

Twelfth Embodiment

A twelfth embodiment of the present invention is now discussed. Thetwelfth embodiment accounts for a change in the positional relationshipbetween two designated fixed positions and a single designated movingposition when an operation to perform is interpreted from a combinationof travel paths of at least two designated positions.

FIG. 97 is a flow diagram showing an algorithm for determining apositional relationship between designated fixed positions and adesignated moving position. As shown, in step S9701, a process isperformed to determine the positional relationship between the twodesignated fixed positions and the designated moving position. In stepS9702, a designation interpretation process is performed to interpretthe input based on the acquired positional relationship.

FIG. 98 is a flow diagram showing an algorithm for determining thepositional relationship between designated positions. In step S9801, theangle of a line connecting the two designated fixed positions(fixed-to-fixed-position angle) is acquired. In step S9802, a process isperformed to acquire the angle of a line connecting one of the twodesignated fixed positions to the designated moving position(fixed-to-moving-position angle). In step S9803, a process is performedto acquire the relationship between the angle of the line connecting thetwo designated fixed position and the angle of the line connecting theone of the two designated fixed position and the designated movingposition. In step S9804, a process is performed to acquire a change inthe relationship between the two angles.

FIG. 99 is a flow diagram showing an algorithm for determining thepositional relationship between the designated positions. When thefixed-to-fixed-position angle is smaller than thefixed-to-moving-position angle in step S9901, the algorithm proceeds tostep S9902, and the positional relationship is determined to be in aclockwise rotation direction. When the fixed-to-fixed-position angleequals the fixed-to-moving position angle in step S9901, the algorithmproceeds to step S9903, and the positional relationship is determined tobe coincident. When the fixed-to-fixed-position angle is greater thanthe fixed-to-moving position angle in step S9901, the algorithm proceedsto step S9904, and the positional relationship is determined to be in acounterclockwise rotation direction.

FIG. 100 is a flow diagram showing an algorithm for acquiring a changein the positional relationship between the designated positions. Whenthe latest position of a designated position fails to coincide with theinitial position thereof in step S10001, the algorithm proceeds to stepS10002. When the initial positional relationships of the designatedpositions fail to be coincident in step S10002, the algorithm proceedsto step S10003. When the latest positional relationships of thedesignated positions fail to be coincident in step S10003, the algorithmproceeds to step S10004. The positional relationship is thus determinedto be an inversion.

FIG. 101 is a flow diagram showing the designation interpretationprocess based on the positional relationship between the designatedfixed positions and the designated moving position. When the determinedchange in the positional relationship is found to be an inversion instep S10101, the algorithm proceeds to step S10102. The input is thusinterpreted as an inversion operation with respect to a line connectingthe designated fixed positions.

FIGS. 102A and 102B show an operational example that is interpreted as asymmetrical inversion operation. There are shown two designated fixedposition points A and B, and a designated moving position point C. Thedesignated moving position point C moves from Ct₁ to Ct₅. This input isinterpreted as a symmetrical inversion operation.

FIGS. 103A-103E show the corresponding data samples that are interpretedas the symmetrical inversion operation. In a graph 10301, there areshown the designated fixed positions A(3,1) and B(4,6). Thefixed-to-fixed-position angle therebetween is 78.69° with respect to theX direction. The designated moving position point C is placed atCt₁(5,3) at travel start time t₁, and the fixed-to-moving-position anglet₁ to the designated fixed position point A is 45.00°. The pointCt₁(5,3) is placed to the right of the line AB connecting the twodesignated fixed position points A and B. The designated moving positionpoint B is placed at Ct₅(3,3) at travel end time t₅. Thefixed-to-moving-position angle t₅ to the designated fixed position pointA is 90.00° with respect to the X direction. The point Ct₅ is placed tothe left of the line AB connecting the two designated fixed positions.

Tables 10302 list position data of the designated fixed position pointsA and B and the designated moving position point C from time t₁ to timet₅. A table 10303 lists the positional relationship between the twodesignated fixed positions and the designated moving position. Aslisted, the fixed-to-fixed-position angle remains unchanged from 78.69°,and the fixed-to-moving-position angle t₁ increases from 45.00° at t₁ to90.00° at t₅, thereby becoming greater than the fixed-to-fixed-positionangle.

Thirteenth Embodiment

A thirteenth embodiment of the present invention is now discussed. Thethirteenth embodiment accounts for a change in the positionalrelationship between three designated fixed positions and a singledesignated moving position when an operation to perform is interpretedfrom a combination of travel paths of at least two designated positions.

FIG. 104 is a flow diagram showing an algorithm for at least threedesignated fixed positions. When there are at least three designatedfixed positions in step S10401, the algorithm proceeds to step S10402. Aprocess is performed to determine a positional relationship between atleast three designated fixed positions and a designated moving position.In step S10403, a designation interpretation process is performed tointerpret the input based on the positional relationship.

FIG. 105 is a flow diagram of a process for determining the positionalrelationship of the designated moving position with respect to theplurality of designated fixed positions. In step S10501, a process isperformed to acquire fixed-to-fixed-position angles. In step S10502, aprocess is performed to acquire the angle of a line connecting thedesignated moving position and one of the plurality of designated fixedpositions (fixed-to-moving-position angle). In step S10503, a process isperformed to determine a relationship between thefixed-to-fixed-position angle and the fixed-to-moving-position angle. Instep S10504, a process is performed to acquire a change in therelationship of the angles.

FIG. 106 is a flow diagram of a process for acquiring the positionalrelationship between at least three designated fixed positions and asingle designated moving position. In step S10601, designated fixedpositions are retrieved from a list of designated fixed positions from adesignated fixed position table. A first designated fixed position isretrieved from the designated fixed position list in step S10602. Whenthe designated fixed position to be retrieved is higher in listing orderthan the last designated fixed position in the list in step S10603, thealgorithm proceeds to step S10604 to retrieve the designated fixedposition. In step S10605, the fixed-to-moving-position angle is found tobe not more than the maximum fixed-to-fixed-position angle, thealgorithm proceeds to step S10606. When the fixed-to-moving-positionangle is found to be not less than the minimum fixed-to-fixed-positionangle in the step S10606, the algorithm proceeds to step S10607 toadvance in the list.

When the designated fixed position reaches the last one in the list inthe step S10603, the algorithm proceeds to step S10608. The designatedmoving position is interpreted as being present within an area definedby the designated fixed positions. When the fixed-to-moving-positionangle is found to be more than the maximum fixed-to-fixed-position anglein the step S10605, the algorithm proceeds to step S10609. When thefixed-to-moving-position angle is found to be less than the minimumfixed-to-fixed-position angle in step S10606, the algorithm proceeds tostep S10609. The designated moving position is interpreted as beingpresent outside the area of the designated fixed positions.

FIG. 107 shows an operational example that is interpreted to mean thatthe designated moving position is within an area defined by thedesignated fixed positions. As shown, the positional relationship of adesignated moving position Dt₁ is interpreted as being within the areathat is enclosed by designated fixed positions A, B, and C.

FIGS. 108A-108F show the corresponding data samples which areinterpreted to mean that the designated moving position is within thearea defined by the designated fixed positions. In a graph 10801, thereare shown the designated fixed position A(3,1), the designated fixedposition B(4,6), the designated fixed position C(6,5.5), and thedesignated moving position Dt₁(4,4). The angle DAO of the lineconnecting the designated fixed position to the point Dt₁, being 71.57°,is between the angle BAO at the designated fixed position A being 78.69°and the angle CAO at the designated fixed position A being 56.31°. Theangle O′BD of the line connecting the point Dt₁ to the designated fixedposition B, being −90.00°, is between the angle O′BA at the designatedfixed position B being −101.31° and the angle O′BC ad the designatedfixed position B being −14.04°.

Tables 10802 list position data of the designated fixed positions A, B,and C, and the designated moving position D. A table 10803 list changesin the positional relationship between the designated fixed positionsand the designated moving position. As listed, the angle DAO from thedesignated fixed position to the designated moving position D(fixed-to-moving-position angle), being 71.57°, is between the(fixed-to-fixed-position) angle BAO being 78.69° and the(fixed-to-fixed-position) angle CAO being 56.31°. The angle O′BD fromthe designated moving position D to the designated fixed position B(fixed-to-moving-position angle) being −90.00°, is between the(fixed-to-moving) angle O′BA being −101.31° and the (fixed-to-fixed)angle O′BC being −14.04°.

FIG. 109 is a flow diagram showing an algorithm for acquiring thepositional relationship between the designated positions. When thechange in the positional relationship is determined to be an outwardshifting out from within the area in step S10901, the algorithm proceedsto step S10902. The input is thus interpreted as an outward shiftingoperation from within the area. When the change in the positionalrelationship is determined not to be an outward shifting operation outfrom within the area in step S10901, the algorithm proceeds to stepS10903. When the change in the positional relationship is determined tobe an inward shift operation into the area in the step S10903, thealgorithm proceeds to step S10904. The input is thus interpreted as aninward shifting operation into the area.

FIGS. 110A and 110B show an operational example which is interpreted asan outward shifting operation from within the area of the designatedfixed positions. As shown, the moving position Dt₁ outwardly moves toDt₅ out of the area enclosed by the designated fixed positions A, B, andC. In the positional relationship of the designated moving position tothe plurality of designated fixed positions, the input is thusinterpreted as an outward shifting operation out of the area of thedesignated fixed positions.

FIGS. 111A-111F show the corresponding data samples which areinterpreted to mean the outward shifting operation from within the areain a positional relationship change determination process. In a graph11101, there are shown a designated fixed position point A(3,1), adesignated fixed position point B(4,6), a designated fixed positionpoint C(6,5.5), and a designated moving position point Dt₁(4,4) attravel start time t₁. The angle DAO of the line connecting the point Dt₁to the designated fixed position point A, being 71.57°, is between theangle BAO at the designated fixed position point A being 78.69° and theangle CAO at the designated position point A being 56.31°. The angleO′BD of the line connecting the point Dt₁ to the designated fixedposition point B being −90.00° is between the angle O′BA at thedesignated fixed position B being −101.31° and the angle O′BC ad thedesignated fixed position B being −14.04°. At the travel end time t₅,the designated moving position point moves to Dt₅(3,4). The angle DAO ofthe line connecting the point Dt₅ to the designated fixed position pointA, being 90.00°, falls outside the range between the angle BAO at thedesignated fixed position point A being 78.69° and the angle CAO at thedesignated position point A being 56.31°. The angle O′BD of the lineconnecting the point Dt₅ to the designated fixed position point B being−116.57 falls outside the range between the angle O′BA at the designatedfixed position B being −101.31° and the angle O′BC ad the designatedfixed position B being −14.04°.

Tables 11102 list position data of the designated fixed position pointsA, B, and C, and the designated moving position point D from time t₁ totime t₅. A table 11103 lists the change in the positional relationshipbetween the designated fixed positions and the designated movingposition. As listed, both the angle DAO of the line connecting the pointD to the designated fixed position point A, and the angle O′BD of theline connecting the point D to the designated fixed position point Bfall within the respective ranges determined by the area of thedesignated fixed positions from time t₁ to time t₃, and depart from therespective ranges at time t₄.

FIG. 112 is a flow diagram showing a designation interpretation processbased on the positional relationship of a designated moving position toa plurality of designated fixed positions. When the positionalrelationship is determined to be an outward shifting operation fromwithin the area in step S11201, the algorithm proceeds to step S11202.The input is then interpreted as a deleting operation for deleting thearea of the designated fixed positions. When the positional relationshipis determined not to be an outward shifting operation from within thearea in step S11201, the algorithm proceeds to step S11203. When thepositional relationship is determined to be an inward shifting operationinto the area in step S11203, the algorithm proceeds to step S11204. Theinput is interpreted as an operation for imparting an attribute to thearea of the designated fixed positions. The attribute impartingoperation may include the coloring of the area of the designated fixedpositions.

FIGS. 113A and 113B show an operational example that is interpreted tomean that an attribute is imparted to the area defined by the designatedfixed positions. When a designated moving position point D is shiftedfrom Dt₁ to Dt₅ into the area enclosed by designated fixed positions A,B, and C, an operation to perform is interpreted as a coloring operationfor coloring the area of the designated fixed positions.

FIGS. 114A-114F show the corresponding data samples that are interpretedas a coloring operation, from among attribute imparting operations, tothe area defined by the designated fixed positions, in a designatedfixed-position based designation interpretation process. In a graph11401, there are shown a designated fixed position point A(3,1), adesignated fixed position point B(4,6), a designated fixed positionpoint C(6,5.5), and a designated moving position point Dt₁(3,4) attravel start time t₁. The angle DAO of the line connecting the point Dt₁to the designated fixed position point A, being 90.00°, falls outsidethe range between the angle BAO at the designated fixed position point Abeing 78.69° and the angle CAO at the designated position point A being56.31°. The angle O′BD of the line connecting the point Dt₁ to thedesignated fixed position point B being −116.57 falls outside the rangebetween the angle O′BA at the designated fixed position B being −101.31°and the angle O′BC ad the designated fixed position B being −14.04°. Atthe travel end time t₅, the angle DAO of the line connecting the pointDt₅ to the designated fixed position point A, being 71.57°, is betweenthe angle BAO at the designated fixed position point A being 78.69° andthe angle CAO at the designated position point A being 59.04°. The angleO′BD of the line connecting the point Dt₅ to the designated fixedposition point B being −90.00° is between the angle O′BA at thedesignated fixed position B being −101.31° and the angle O′BC ad thedesignated fixed position B being −14.04°.

Tables 11432 list position data of the designated fixed position pointsA, B, and C, and the designated moving position point D from time t₁ totime t₅. A table 11433 lists the change in the positional relationshipbetween the designated fixed positions and the designated movingposition. As listed, both the angle DAO of the line connecting the pointD to the designated fixed position point A, and the angle O′BD of theline connecting the point D to the designated fixed position point Bremains outside the respective ranges determined by the area of thedesignated fixed positions from time t₁ to time t₃, and enter therespective ranges at time t₄.

Fourteenth Embodiment

A fourteenth embodiment of the present invention is now discussed. Thefourteenth embodiment accounts for a change in a number of a pluralityof designated positions when an operation to perform is interpreted froma combination of travel paths of at least two designated positions.

FIG. 115 is a flow diagram showing a designation interpretation processbased on a change in the count of a plurality of designated positions.In step S11501, a process is performed to acquire a designated positioncount. In step S11502, a process is performed to acquire a change in thedesignated position count. In step S11503, a designation interpretationprocess is performed to interpret the input based on the acquireddesignated position count.

FIG. 116 is a flow diagram showing the designation interpretationprocess based on the change in the initial count of designatedpositions. In step S11601, a current designated position count iscompared with an initial designated position count. When it isdetermined in step S11602 that the current designated position count isgreater than the initial designated position count, the algorithmproceeds to step S11603. The input is interpreted as being in the middleof designating an object.

FIGS. 117A and 117B show an operational example that is interpreted tomean that the designation of an object to be processed is on its waythrough the designation interpretation process using the change in thedesignated position count. There are shown two designated positionpoints At1 and Bt₁ at time t₁ in FIG. 117A. There are shown threedesignated position points of At₂, Bt₂, and Ct₂ at time t₂ in FIG. 117B.The designated position count increases from two at time t₁ to three attime t₂.

FIGS. 118A-118F show the corresponding data samples that are interpretedto mean that the designation of the object to be processed is on itsway. In graphs 11801, FIG. 118A shows the two designated positions ofAt₁ and Bt₁ occurring at time t₁ and FIG. 118B shows the threedesignated positions of At₂, Bt₂, and Ct₂ occurring at time t₂. Tables11802 list position data of the designated position point A, thedesignated position point B, and the designated position point C fromtime t₁ to time t₃. A table 11803 lists the change in the designatedposition count. As listed, the designated position count is two at timet₁, resulting in a count change of zero. At time t₂, the designatedposition count is three, resulting a count change of one.

FIG. 119 is a flow diagram showing the designation interpretationprocess based on the change in the designated position count. In stepS11901, a process is performed to acquire initial designated positions.When it is determined in step S11902 that the count of the acquiredpositions indicates any increase from the initial count of designatedpositions, the algorithm proceeds to step S11903. A designationinterpretation process is performed to interpret the input based on theinitial designated positions.

FIG. 120 is a flow diagram showing the designation interpretationprocess based the an initial designated position. When the designatedposition count is one, the algorithm proceeds to step S12002. Anoperation to perform is thus interpreted as a rotation operation aboutthe acquired designated position.

FIGS. 121A and 121B show an operational example that is interpreted asthe rotation operation about the designated position. An initialdesignated position point A is present at time t₁. At time t₅, there areshown the designated position point A and a designated position pointBt₅, which has shifted from point Bt₅. This input is interpreted as arotation operation about the designated position point A.

FIGS. 122A-122D show the corresponding data samples which is interpretedas the rotation operation about the designated position. In a graph12201, the designated position point A continuously stays at the samecoordinates (3,3) from time t₁ to time t₆. The designated position pointB takes coordinates Bt₃(6,2.8) at time t₃, coordinates Bt₄(5.6,3.5) attime t₄, coordinates Bt₅(5.2,4.2) at time t₅, and coordinates Bt₆(5,5)at time t₆. Tables 12202 list position data of the designated positionpoints A and B from time t₁ to time t₆. A table 12203 lists the changein the designated position count. As listed, the designated positioncount remains one from time t₁ to time t₂, resulting in a count changeof zero. The designated position count increases to two at time t,resulting in a count change of one. The count continuously remainsunchanged to time t₆.

Fifteenth Embodiment

A fifteenth embodiment of the present invention is now discussed. Thefifteenth embodiment accounts for a change in a number of a plurality offinal designated positions when an operation to perform is interpretedfrom a combination of travel paths of at least two designated positions.

FIG. 123 is a flow diagram showing an algorithm that uses a change inthe last count of designated positions. In step S12301, a process isperformed to acquire a change in the final designated position count. Instep 12302, a designation interpretation process is performed based onthe change in the last designated position count.

FIG. 124 is a flow diagram showing the designation interpretationprocess based on the change in the last count of the designatedpositions. When the designated position count indicates a decrease instep S12401, the algorithm proceeds to step S12402. The input isinterpreted as a canceling operation to cancel the immediately precedingoperation. When the designated position count indicates no decrease instep S12401, the algorithm proceeds to step S12403. The input isinterpreted as a confirmation operation to confirm the immediatelypreceding operation.

FIGS. 125A and 125B show an operational example that is interpreted as acanceling operation to cancel an immediately preceding operation in thedesignation interpretation process. As shown, there are three initialpoints At₁, Bt₁, and Ct₁ at time t₁. At time t₂, there are twodesignated position points At₂ and Bt₂. The designated position count isdecreased by one from time t₁.

FIGS. 126A-126F show the corresponding data samples that are interpretedas the canceling operation to cancel the immediately precedingoperation. In a graph 12601, there are the three initial designatedposition points At₁, Bt₁, and Ct₁ at time t₁. At time t₂, there are thetwo designated position points At₂ and Bt₂. Tables 12602 list positiondata of the designated position points A, B, and C from time t₁ to timet₂. A table 12603 lists the change in the designated position count. Aslisted, the designated position count is three at time t₁, therebyresulting in a count change of zero. The designated position count istwo at time t₂, thereby resulting in a count change of −1.

Sixteenth Embodiment

A sixteenth embodiment of the present invention is now discussed. Thesixteenth embodiment accounts for a designated position count asdesignated information other than the designated path when an operationto perform is interpreted from a combination of travel paths of at leasttwo designated positions.

FIG. 127 is a flow diagram showing an algorithm that uses designatedinformation other than a designated path. In step S12701, a process isperformed to acquire designated information other than the designatedpath. The algorithm proceeds to step S12702. When it is determined instep S12702 that an operation is not repeated, the algorithm proceeds tostep S12703. A designation interpretation process is performed tointerpret the input based on the acquired designated information. Whenit is determined in the step S12702 that the operation is repeated, thealgorithm proceeds to step S12704. The input is interpreted as asuspending operation to suspend the operation, and the process thenproceeds to step S12703.

FIG. 128 is a flow diagram showing an algorithm that uses designatedinformation other than a designated path. When the designatedinformation is equal to or greater than the maximum criterion value, thealgorithm proceeds to step S12802. The input is interpreted as a maximumoperational amount. When the designated information is smaller than themaximum criterion value, the algorithm proceeds to step S12803. When thedesignated information is equal to or greater than a repetitioncriterion value, the algorithm proceeds to step S12804 to increase anoperational amount. The algorithm proceeds to step S12805. The input isthus interpreted as an operation to narrow repetition intervals. When itis determined in the step S12803 that the designated information issmaller than the repetition criterion value, the algorithm proceeds tostep S12806. The input is thus interpreted as an operation to increasethe operational amount.

FIG. 129 is a flow diagram showing an algorithm that uses the count ofall designated positions. In step S12901, a process is performed toacquire the count of all designated positions as the designatedinformation other than the designated path.

FIG. 130 is a flow diagram showing a designation interpretation processbased on the designated position count as the designated informationother than the designated path. When the designated position count isequal to or greater than the maximum criterion value, the algorithmproceeds to step S13002. The input is interpreted as one of the maximumnumber of screens, the maximum number of items, and the maximummagnification. When the designated position count is smaller than themaximum criterion count, the algorithm proceeds to step S13003. When thedesignated position count is equal to or greater than a repetitioncriterion value in the step S13003, the algorithm proceeds to stepS13004. The input is interpreted as an operation to increase one of thenumber of pages, the number of screens, the number of items, andmagnification. The algorithm proceeds to step S13005. The input is theninterpreted as an operation to narrow repetition intervals. When it isdetermined in the step S13003 that the designated position number issmaller than the repetition criterion value, the algorithm proceeds tostep S13006. The input is interpreted as an operation to increase one ofthe number of pages, the number of screens, the number of items, andmagnification. The algorithm proceeds to step S13007 to interpret theinput as one of a page-turning operation, a screen shifting operation,an item advancing operation, and an expansion/contraction operation.

FIGS. 131A and 131B show an operational example that is interpreted asthe page-turning operation. FIG. 131A shows two designated positionpoints At₁ and Bt₁ appearing at time t₁. FIG. 131B shows a total of fourdesignated position points At₂, Bt₂, Ct₂, and Dt₂ appearing at time t₂.Since the designated position count is increased to four at time t₂ fromtwo at time t₁, the input is interpreted as an operation for increasingthe number of pages in page turning.

FIGS. 132A-132H show the corresponding data samples that are interpretedas the page-turning operation. Graphs 13201 show two designated positionpoints At₁ and Bt₁ appearing at time t₁ and a total of four designatedposition points At₂, Bt₂, Ct₂, and Dt₂ appearing at time t₂. Tables13202 list position data of the designated positions A, B, C, and D fromt, to t₂. A table 13203 lists the change in the designated positioncount. As listed, the increase in the designated position count is twoat time t₁, resulting a total number of designated positions of three.At time t₂, the increase in the designated position count is two,resulting in a total number of five.

Seventeenth Embodiment

A seventeenth embodiment of the present invention is now discussed. Theseventeenth embodiment accounts for the speed of travel of a designatedposition as the designated information other than the designated pathwhen an operation to perform is interpreted from a combination of travelpaths of at least two designated positions.

FIG. 133 is a flow diagram showing an algorithm for acquiring the speedof travel of the designated position as the designated positioninformation other than the designated path. In step S13301, a process isperformed to acquire the speed of travel of the designated position. Instep S13302, a designation interpretation process is performed tointerpret the input based on the travel speed of the designatedposition.

FIG. 134 is a flow diagram showing an algorithm for acquiring the speedof travel of the designated position. In step S13401, the distance oftravel of the designated position from the immediately preceding pointthereof is acquired. In step S13402, the speed of travel is calculatedfrom the acquired travel distance and time needed for the travel.

FIG. 135 is a flow diagram showing the designation interpretationprocess based on the designated position travel speed as the designatedinformation other than the designated path. When it is determined instep S13501 that the travel speed of the designated position is equal toor greater than the maximum criterion value, the algorithm proceeds tostep S13502. The input is interpreted as one of the maximum number ofpages, the maximum number of screens, the maximum number of items, andthe maximum magnification. When it is determined in step S13501 that thetravel speed of the designated position is smaller than the maximumcriterion value, the algorithm proceeds to step S13503. When it isdetermined in step S13503 that the designated position travel speed isequal to or greater than the repetition criterion value, the algorithmproceeds to step S13504. The input is interpreted as an operation toincrease one of the number of pages, the number of screens, the numberof items, and magnification. The algorithm proceeds to step S13505 tointerpret the input as an operation to narrow repetition intervals. Whenit is determined in the step S13503 that the designated position travelspeed is smaller than the repetition criterion value, the algorithmproceeds to step S13506. The input is interpreted as an operation toincrease one of the number of pages, the number of screens, the numberof items, and magnification. The algorithm then proceeds to step S13507to interpret the input as one of a page-turning operation, a screenshifting operation, an item advancing operation, and anexpansion/contraction operation.

FIGS. 136A-136D show an operational example that is interpreted as apage turning using the designated position travel speed. Designatedposition points A and B respectively move from points At₁ and Bt₁ to At₅and Bt₅ as shown in FIGS. 136A and 136B. Designated position points A′and B′ respectively move from points A′t₁ and B′t₁ to A′t_(s) and B′t₅as shown in FIGS. 136C and 136D. The travel speed is considered to behigher in the first case shown in FIGS. 136A and 136B than in the secondcase shown in FIGS. 136C and 136D.

FIGS. 137A-137G show the corresponding data samples that are interpretedas the page turning using the designated position travel speed. In agraph 13701, at time t₁, the designated position points At₁ and A′t₁ areat the same coordinates (4,2), and the designated position points Bt₁and B′t₁ are at the same coordinates (5,3). At time t₅, the designatedpositions A and B are respectively at coordinates At₅(3,3) andcoordinates A′t₅(3,4), and coordinates Bt₅(4,4), and coordinatesB′t₅(4,5).

Tables 13702 list position data of the designated positions A, B, A′,and B′ from t₁ to t₅. A table 13703 lists the travel speed of thedesignated positions. As listed, the travel speed of the designatedposition point A′ being 0.559 and the travel speed of the designatedposition point B′ being 0.559 are respectively greater than the travelspeed of the designated position point A being 0.35 and the travel speedof the designated position point B being 0.283.

Eighteenth Embodiment

An eighteenth embodiment of the present invention is now discussed. Theeighteenth embodiment accounts for a contact pressure of a designatedposition as the designated information other than the designated pathwhen an operation to perform is interpreted from a combination of travelpaths of at least two designated positions.

FIG. 138 is a flow diagram showing an algorithm that uses a contactpressure at a designated position as the designated information otherthan the designated path. In step S13801, a process is performed toacquire the contact pressure at the designated position. In step S13802,a designation interpretation process is performed to interpret the inputbased on the contact pressure at the designated position.

FIG. 139 is a flow diagram showing the designation interpretationprocess based on the designated position contact pressure. When it isdetermined in step S13901 that the contact pressure at the designatedposition is equal to or greater than the maximum criterion value, thealgorithm proceeds to step S13902. The input is interpreted as one ofthe maximum number of screens, the maximum number of items, and themaximum magnification. When it is determined in the step S13901 that thecontact pressure at the designated position is smaller than the maximumcriterion value, the algorithm proceeds to step S13903. When it isdetermined in the step S13903 that the contact pressure at thedesignated position is equal to or greater than the repetition criterionvalue, the algorithm proceeds to step S13904. The input is interpretedas an operation to increase one of the number of screens, the number ofitems, and magnification. The algorithm then proceeds to step S13905 tonarrow repetition intervals. When it is determined in the step S13903that the contact pressure at the designated position is smaller than therepetition criterion value, the algorithm proceeds to step S13906. Theinput is interpreted as an operation to increase one of the number ofscreens, the number of items, and magnification. The algorithm proceedsto step S13907 to interpret the input as one of a screen shiftingoperation, an item advancing operation, and an expansion/contractionoperation.

FIGS. 140A-140D show an operational example that is interpreted as ascreen shifting operation in response to the designated position contactpressure. Designated position points At₁(3,3) and Bt₁(4,4) cause a highcontact pressure than designated position points Ct₁(3,3) and Dt₁(4,4).

FIGS. 141A-141H show the corresponding data samples that are interpretedas the screen shifting operation in response to the designated positioncontract pressure. In graphs 14101, for a time elapse from time t₁ totime t₅, the designated position points A and B respectively move fromAt₁(3,3) and Bt₁(4,4) move to At₅(3,1) and Bt₅(4,2). Similarly,designated position points C and D respectively move from Ct₁(3,3) andDt₁(4,4) to Ct₅(3,1) and Dt₅(4,2). Tables 14102 list position data ofthe designated position points A, B, C, and D from time t₁ to time t₅. Atable 14103 lists the contact pressure at each designated positionpoint. As listed, a change in the contact pressure of each of thedesignated position points C and D from time t₁ to time t₅ is greaterthan a change in the contact pressure of each of the designated positionpoints A and B from time t₁ to time t₅.

Nineteenth Embodiment

A nineteenth embodiment of the present invention is now discussed. Thenineteenth embodiment accounts for travel distances of a plurality ofdesignated positions as the designated information other than thedesignated path when an operation to perform is interpreted from acombination of travel paths of at least two designated positions.

FIG. 142 is a flow diagram showing an algorithm that uses the distancesof travel of a plurality of designated positions. In step S14201, aprocess is performed to acquire the distances of travel of thedesignated positions. In step S14202, a designation interpretationprocess is performed to interpret the input based on the distances oftravel of the designated positions.

FIG. 143 is a flow diagram showing the designation interpretationprocess based on the distances of travel of the plurality of designatedpositions. In this algorithm, when it is determined in step S14301 thatthe travel distance is equal to or greater than the maximum criterionvalue, the algorithm proceeds to step S14302. The input is interpretedas one of the maximum number of pages, the maximum number of screens,the maximum number of items, and the maximum magnification. When it isdetermined in the step S14301 that the travel distance is smaller thanthe maximum criterion value, the algorithm proceeds to step S14303. Whenit is determined in step S14303 that the travel distance is equal to orgreater than a repetition criterion value, the algorithm proceeds tostep S14304. The input is interpreted as an operation to increase one ofthe number of pages, the number of screens, the number of items, andmagnification. The algorithm then proceeds to step S14305 to interpretthe input as an operation to narrow repetition intervals. When it isdetermined in the step S14303 that the travel distance is smaller thanthe repetition criterion value, the algorithm proceeds to step S14306.The input is interpreted as an operation to increase one of the numberof pages, the number of screens, the number of items, and magnification.The algorithm then proceeds to step S14307 to interpret the input as oneof a page shifting operation, a screen shifting operation, an itemadvancing operation, and an expansion/contraction operation.

FIGS. 144A-144D show an operational example that is interpreted as apage-turning operation in response to the distances of travel of theplurality of designated positions. Designated position points A and Bare respectively moved from coordinates At₁(4,2) and coordinatesBt₁(5,3) at time t₁ to coordinates At₅(3,3) and coordinates Bt₅(4,4) attime t₅ as shown in FIGS. 144A and 144B. Designated position points A′and B′ are respectively moved from coordinates A′t₁(4,2) and coordinatesB′t₁(5,3) at time t₁ to coordinates A′t₅(3,6) and coordinates B′t₅(4,7)at time t₅ as shown in FIGS. 144C and 144D.

FIGS. 145A-145G show the corresponding data samples that are interpretedas the page-turning operation in response to the distances of travel ofthe plurality of designated positions. In a graph 14501, at time t₁, thedesignated position points At₁ and A′t₁ are at the same coordinates(4,2), and the designated position points Bt₁ and B′t₁ are at the samecoordinates (5,3). At time t₅, the designated positions A and B arerespectively at coordinates At₅(3,3) and coordinates A′t₅(3,6), andcoordinates Bt₅(4,4), and coordinates B′t₅(4,7). Tables 14502 listposition data of the designated positions A, B, A′, and B′ from t₁ tot₅. A table 14503 lists the travel distance data of the designatedpositions. As listed, the travel distance of the designated positionpoint A′ being 4.123 and the travel speed of the designated positionpoint B′ being 4.123 are respectively greater than the travel speed ofthe designated position point A being 1.414 and the travel speed of thedesignated position point B being 1.131.

Twentieth Embodiment

A twentieth embodiment of the present invention is now discussed. Thetwentieth embodiment accounts for stationary times of a plurality ofdesignated positions when an operation to perform is interpreted from acombination of travel paths of at least two designated positions.

FIG. 146 is a flow diagram showing an algorithm that uses the stationarytimes of the plurality of designated positions. In step S14601, aprocess is performed to acquire stationary time of a designatedposition. The algorithm proceeds to step S14602. When it is determinedthat the designated position remains stationary for a predeterminedduration of time, the algorithm proceeds to step S14603. The input isinterpreted as an operation for designating an area. The designated areais thus clearly distinguished from the remaining area of a display. Whenit is determined that the designated position is not stationary in thestep S14602, the algorithm proceeds to step S14604. The input is theninterpreted as an operation for the designated area.

FIGS. 147A and 147B show an operational example that is interpreted asan area designating operation. Designated position points A and B areplaced at At₁ and Bt₁ on a line of characters at time t₁. When thedesignated position points remains at At₅ and Bt₅ on the same line ofcharacter at time t₅ as shown, the area between the designated positionpoints A and B is interpreted as being designated.

FIGS. 148A-148D show the corresponding data samples that are interpretedas the area designating operation. In a graph 14801, the designatedposition point A continuously stays at coordinates A(3,3) from time t₁to time t₅. Also, the designated position point B continuously stays atcoordinates B(4,4) from time t₁ to time t₅. Tables 14802 list positiondata of the designated position points A and B from time t₁ to time t₅.A table 14803 lists the distances of travel of the designated positionpoints A and B. As listed, the distance of travel of the designatedposition point A is zero at time t₁, and is continuously zero from timet₂ to time t₅. Also, the distance of travel of the designated positionpoint B is continuously zero from time t₁ to time t₅. The designatedposition points A and B remain stationary from time t₁ to time t₅.

FIGS. 149A and 149B show an operational example that is interpreted asan expansion operation to be effected on a designated area. Thedesignated position points A and B are placed at At₅ and Bt₅ on a lineof characters at time t₅. The designated position points A and B arerespectively moved to At₆ and Bt₆ at time t₆. This input is nowinterpreted as an operation to expand the designated area.

FIGS. 150A-150D show the corresponding data samples that are interpretedas the expansion operation to be effected on the designated area. In agraph 15001, the designated position points A and B respectivelycontinuously stay at the same coordinates A(3,3) and B(4,4) from time t₁to time t₅. The coordinates A_(t)6(2,2.5) and B_(t)6(4,4) taken by thedesignated position points A and B at time t₆ are spaced more apart fromeach other than the coordinates At₅ and Bt₅ are at time t₅. Tables 15002list position data of the designated position points A and B from timet₁ to time t₆. A table 15003 lists the change in the distance of travelof each designated position point. As listed, the travel distances ofthe designated position points A and B are zero from time t₁ to time t₅.The magnification resulting from the distance change between thedesignated position points A and B is 100%. At time t₆, the traveldistance of the point A is 1.118 and the travel distance of the point Bis 2.236. The magnification resulting from the distance change betweenthe point A and the point B increases to 285%.

The present invention may be implemented in a system constructed of aplurality of apparatuses (including a host computer, interface units, adisplay, etc.) or may be implemented in a standalone apparatus.

A program code of software for carrying out the functions of theembodiments is loaded in a computer in a system or apparatus connectedto a variety of devices so that the devices perform the functions of theabove embodiments. The variety of devices operate according to theprogram code stored in the computer (CPU or MPU) in the system orapparatus. Such embodiments fall within the scope of the presentinvention. The program code of software performs the functions of theembodiment. The program code itself, and means for feeding the programcode to the computer, for example, a storage medium for storing theprogram code, fall within the scope of the present invention.

Available as storage media for feeding the program code are a floppydisk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, aCD-R, a magnetic tape, a nonvolatile memory card, ROM and the like.

By executing the program code read by the computer, the functions of theembodiments are performed. Furthermore, the functions of the aboveembodiments are performed in cooperation with the OS (operating system)running on the computer or another application software programaccording to the instruction of the program code. Such a program codefalls within the scope of the present invention.

The program code from the storage medium is read into a memoryincorporated in a feature expansion board in the computer or in afeature expansion unit connected to the computer. The CPU mounted on thefeature expansion board or the feature expansion unit performs partly orentirely the actual process in response to the instruction from theprogram code. The functions of the above embodiment are executed throughthe process. Such a program code falls within the scope of the presentinvention.

To incorporate the present invention to the storage medium, the programcode of the above-referenced flow diagrams may be stored in the storagemedium.

Although the present invention has been described in its preferred formwith a certain degree of particularity, many apparently widely differentembodiments of the invention can be made without departing from thespirit and the scope thereof. It is to be understood that the inventionis not limited to the specific embodiments thereof except as defined inthe appended claims.

While the present invention has been described with reference to whatare presently considered to be the preferred embodiments, it is to beunderstood that the invention is not limited to the disclosedembodiments. On the contrary, the invention is intended to cover variousmodifications and equivalent arrangements included within the spirit andscope of the appended claims. The scope of the following claims is to beaccorded the broadest interpretation so as to encompass all suchmodifications and equivalent structures and functions.

1.-156. (canceled)
 157. An information processing apparatus comprising:a display control unit configured to cause a display screen to displayan image; a detection unit configured to detect a plurality ofdesignated positions which is designated in the image displayed on thedisplay screen by the display control unit at the same time; and aninterpreting unit configured to, in a case where it is detected that theplurality of designated positions remains stationary during apredetermined period, interpret the designation based on the designatedpositions as a first operation for determining a designated area withinthe image based on the plurality of designated positions detected by thedetection unit, and in a case where it is detected that the plurality ofdesignated positions moves, interpret the designation based on thedesignated positions as a second operation different from the firstoperation according to the movement of the plurality of designatedpositions.
 158. The information processing apparatus according to claim157, wherein the interpreting unit interprets, in a case where it isdetected that the plurality of designated positions moves in directionssuch that the plurality of designated positions becomes further awayfrom each other, the designation based on the designated positions as anexpansion operation according to the movement of the plurality ofdesignated positions.
 159. The information processing apparatusaccording to claim 158, wherein magnification of the expansion operationcorresponds to a ratio of change in a distance of travel between thedesignated positions detected by the detection unit.
 160. Theinformation processing apparatus according to claim 159, wherein theinterpreting unit interprets, in a case where it is detected that theplurality of designated positions, on an area within the image where acharacter string is displayed, remains stationary during thepredetermined period, the designation based on the designated positionsas the first operation for designating an area of a character includedin the character string which is enclosed by the plurality of designatedpositions detected by the detection unit.
 161. The informationprocessing apparatus according to claim 160, wherein the display controlunit displays, in a case where the interpreting unit interprets thedesignation based on the designated positions as the first operation fordesignating an area of a character which is enclosed by the plurality ofdesignated positions detected by the detection unit, the designed areaof the character in a manner that clearly distinguishes the designedarea of the character from the remaining area.
 162. An operationalmethod comprising: displaying an image on a display screen; detecting aplurality of designated positions which is designated in the imagedisplayed on the display screen at the same time; interpreting, in acase where it is detected that the plurality of designated positionsremains stationary during a predetermined period, the designation basedon the designated positions as a first operation for determining adesignated area within the image based on the plurality of designatedpositions; and interpreting, in a case where it is detected that theplurality of designated positions moves, the designation based on thedesignated positions as a second operation different from the firstoperation according to the movement of the plurality of designatedpositions.
 163. A non-transitory computer-readable storage mediumstoring a manipulation program for controlling to perform manipulation,the program comprising codes for causing the computer to perform:displaying an image on a display screen; detecting a plurality ofdesignated positions which is designated in the image displayed on thedisplay screen at the same time; interpreting, in a case where it isdetected that the plurality of designated positions remains stationaryduring a predetermined period, the designation based on the designatedpositions as a first operation for determining a designated area withinthe image based on the plurality of designated positions; andinterpreting, in a case where it is detected that the plurality ofdesignated positions moves, the designation based on the designatedpositions as a second operation different from the first operationaccording to the movement of the plurality of designated positions.